[ 621.317481] env[69728]: INFO neutron.common.config [-] Logging enabled! [ 621.317481] env[69728]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev43 [ 621.317747] env[69728]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69728) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 621.318914] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 621.318914] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 621.319171] env[69728]: WARNING oslo_policy.policy [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 621.319484] env[69728]: WARNING oslo_policy.policy [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 621.321242] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] VMware NSXv3 Agent initialized successfully. [ 621.321623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] Acquiring lock "singleton_lock" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.321754] env[69728]: DEBUG oslo_concurrency.lockutils [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] Acquired lock "singleton_lock" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.321956] env[69728]: DEBUG oslo_concurrency.lockutils [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] Releasing lock "singleton_lock" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.322256] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] Full set of CONF: {{(pid=69728) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 621.322457] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ******************************************************************************** {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 621.322823] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] Configuration options gathered from: {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 621.322823] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 621.322969] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 621.323090] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ================================================================================ {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 621.323261] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] agent_down_time = 75 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.323623] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] allow_automatic_dhcp_failover = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.323623] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] allow_bulk = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.323712] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] api_extensions_path = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.323858] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] api_paste_config = api-paste.ini {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324499] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] auth_strategy = keystone {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324499] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] backdoor_port = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324499] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] backdoor_socket = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324499] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] backlog = 4096 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324608] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] base_mac = fa:16:3e:00:00:00 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324739] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] bind_host = 0.0.0.0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.324887] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] bind_port = 9696 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.325210] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] client_socket_timeout = 900 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.325210] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] config_dir = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.325360] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.325423] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] config_source = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.325564] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] control_exchange = neutron {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327775] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] core_plugin = ml2 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327775] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] debug = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327775] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] default_availability_zones = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327775] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327775] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] dhcp_agent_notification = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] dhcp_agents_per_network = 1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] dhcp_lease_duration = 86400 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] dhcp_load_type = networks {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] dns_domain = openstacklocal {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_default_route_bfd = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.327965] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_default_route_ecmp = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328153] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_dvr = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328153] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_new_agents = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328153] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328153] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_signals = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328153] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] enable_traditional_dhcp = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328281] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] external_dns_driver = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328312] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] filter_validation = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328494] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] global_physnet_mtu = 8950 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328581] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] graceful_shutdown_timeout = 60 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328754] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] host = cpu-1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.328893] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] host_dvr_for_dhcp = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329037] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] http_retries = 3 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329186] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] instance_format = [instance: %(uuid)s] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329324] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329458] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ipam_driver = internal {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329589] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ipv6_pd_enabled = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329719] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] l3_ha = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329858] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.329992] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] l3_ha_network_physical_name = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.330138] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] l3_ha_network_type = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.330273] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_color = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.330407] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_config_append = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_dir = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_file = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_options = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_rotate_interval = 1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_rotate_interval_type = days {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331454] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] log_rotation_type = none {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331678] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331678] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331678] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331759] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331920] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.331990] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] max_dns_nameservers = 5 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332140] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] max_header_line = 16384 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332270] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] max_l3_agents_per_router = 3 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332399] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] max_logfile_count = 30 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332528] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] max_logfile_size_mb = 200 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332656] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] max_subnet_host_routes = 20 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332790] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] my_ip = 10.180.1.21 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.332924] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] my_ipv6 = ::1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.333064] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] network_auto_schedule = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.333192] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] network_link_prefix = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.333324] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.333458] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] notify_nova_on_port_data_changes = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] notify_nova_on_port_status_changes = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] pagination_max_limit = -1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] publish_errors = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] rate_limit_burst = 0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] rate_limit_except_level = CRITICAL {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] rate_limit_interval = 0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.334850] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] retry_until_window = 30 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335058] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] router_distributed = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335058] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] rpc_resources_processing_step = 20 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335058] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] rpc_response_max_timeout = 600 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335058] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] rpc_response_timeout = 60 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335058] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] send_events_interval = 2 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335268] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] service_plugins = ['router'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335403] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] setproctitle = on {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] shell_completion = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335672] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] state_path = /opt/stack/data/neutron {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335809] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] syslog_log_facility = LOG_USER {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.335944] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] tcp_keepidle = 600 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336094] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] transport_url = **** {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336230] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] use_journal = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336582] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] use_json = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336582] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] use_ssl = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336721] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] use_stderr = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336767] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] use_syslog = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.336874] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] vlan_qinq = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337414] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] vlan_transparent = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337414] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] watch_log_file = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337414] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] wsgi_default_pool_size = 100 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337623] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] wsgi_keep_alive = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337623] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337723] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] wsgi_server_debug = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 621.337854] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_concurrency.disable_process_locking = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.337979] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.338162] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.338309] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.338837] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.338837] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.338837] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339049] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.connection_string = messaging:// {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339049] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.enabled = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339160] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.es_doc_type = notification {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339296] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.es_scroll_size = 10000 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339439] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.es_scroll_time = 2m {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339576] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.filter_error_trace = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339718] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.hmac_keys = **** {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.339984] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.sentinel_service_name = mymaster {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340065] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.socket_timeout = 0.1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340141] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.trace_requests = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340275] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler.trace_sqlalchemy = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340651] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler_jaeger.process_tags = {} {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340651] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler_jaeger.service_name_prefix = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340719] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] profiler_otlp.service_name_prefix = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.340865] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.enforce_new_defaults = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.341396] env[69728]: WARNING oslo_config.cfg [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 621.341396] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.enforce_scope = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.341396] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.policy_default_rule = default {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.341543] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.341686] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.342009] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.342009] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.342150] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.342236] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.342378] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_policy.remote_timeout = 60.0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] agent.extensions = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] service_providers.service_provider = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344535] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.default_quota = -1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_floatingip = 50 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_network = 100 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_port = 500 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_router = 10 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344706] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_security_group = 10 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344877] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344877] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.quota_subnet = 100 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344877] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] QUOTAS.track_quota_usage = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344877] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.344877] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep.group = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345013] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep.helper_command = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345181] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345324] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep.thread_pool_size = 8 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345453] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep.user = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345597] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345729] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_dhcp_release.group = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345858] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_dhcp_release.helper_command = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.345993] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346141] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346271] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_dhcp_release.user = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346412] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346541] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_ovs_vsctl.group = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346669] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_ovs_vsctl.helper_command = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346805] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.346938] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.347244] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_ovs_vsctl.user = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.347244] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_namespace.capabilities = [21] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.347373] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_namespace.group = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.347505] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_namespace.helper_command = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.347640] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348263] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_namespace.thread_pool_size = 8 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348263] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_namespace.user = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348263] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_conntrack.capabilities = [12] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348263] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_conntrack.group = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348469] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_conntrack.helper_command = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348469] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348569] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348699] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_conntrack.user = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348837] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_link.capabilities = [12, 21] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.348967] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_link.group = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.349106] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_link.helper_command = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.349242] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.349387] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_link.thread_pool_size = 8 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.349555] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] privsep_link.user = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.349642] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350168] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350168] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.continue_on_failed_promotions = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350168] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.dscp = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350256] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.dscp_inherit = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350629] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.force_mp_to_policy = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350629] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.locking_coordinator_url = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350629] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.log_agent_heartbeats = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350836] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.logging_expire = 1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.350886] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.351327] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.351327] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.polling_interval = 240 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.351327] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.351456] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.351610] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.report_interval = 30.0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352133] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352133] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352133] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352133] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.sync_skew = 60 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352676] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.synchronization_queue_size = 20 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352676] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT.use_helper_for_ns_read = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352676] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] SECURITYGROUP.enable_ipset = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352676] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] SECURITYGROUP.enable_security_group = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.352832] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.353286] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.353286] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] experimental.ipv6_pd_enabled = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.353286] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.extension_drivers = ['port_security'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.353484] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.external_network_type = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.353534] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.353677] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.overlay_ip_version = 4 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354423] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.path_mtu = 8950 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354423] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.physical_network_mtus = {} {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354423] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.tenant_network_types = ['vlan'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354423] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354423] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ml2.type_drivers = ['vlan'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354608] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT_CLI.neutron_port_id = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354696] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.354816] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355211] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355211] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355319] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355473] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355948] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355948] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.355948] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356156] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_login_password = **** {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356202] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_login_port = 443 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356598] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_login_user = admin {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356598] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356598] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356756] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.356890] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.357045] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.357308] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.357380] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.357531] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358016] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358016] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358016] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358123] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358276] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358468] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358670] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] vsphere.vsphere_login_password = VMware1! {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358763] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.358909] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359071] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.auth_section = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359222] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.auth_type = password {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359634] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359634] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.certfile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359634] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.collect_timing = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359776] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.endpoint_type = public {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.359921] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.insecure = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.360338] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.keyfile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.360338] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.region_name = RegionOne {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.360338] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.split_loggers = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.360475] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] nova.timeout = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.360615] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.auth_section = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.360760] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.auth_type = password {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361047] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361047] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.certfile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361389] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.collect_timing = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361389] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.endpoint_type = public {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361487] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.insecure = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361781] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.keyfile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361781] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.region_name = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.361869] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.split_loggers = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362171] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] placement.timeout = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362171] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.auth_section = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362339] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.auth_type = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362685] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.cafile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362685] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.certfile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362685] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.collect_timing = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.362780] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.connect_retries = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363052] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.connect_retry_delay = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363052] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.enable_notifications = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363658] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.endpoint_override = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363658] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.insecure = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363658] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.interface = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363658] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.keyfile = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363989] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.max_version = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363989] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.min_version = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.363989] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.region_name = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364136] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.retriable_status_codes = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364252] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.service_name = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364380] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.service_type = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364519] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.split_loggers = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364659] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.status_code_retries = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364802] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.status_code_retry_delay = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.364923] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.timeout = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365102] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.valid_interfaces = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365254] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ironic.version = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365399] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] cli_script.dry_run = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365549] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365688] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365828] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.365968] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.366125] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.366270] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.366411] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.366556] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.366725] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.366876] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.367051] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.367295] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.367383] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.367547] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.367690] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.367868] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.368440] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.368440] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.368440] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.368566] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.368694] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.368853] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369010] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369161] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369304] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369446] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369585] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369724] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.369866] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.370015] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.370193] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.ssl = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.370391] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.370560] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.370687] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.370830] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371027] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.ssl_version = {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371129] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371283] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_notifications.driver = [] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371426] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_notifications.retry = -1 {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371582] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371722] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] oslo_messaging_notifications.transport_url = **** {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 621.371846] env[69728]: DEBUG oslo_service.backend.eventlet.service [None req-35f2c7eb-37a5-4d46-bb01-5efc57e89586 None None] ******************************************************************************** {{(pid=69728) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 621.372829] env[69728]: DEBUG neutron.agent.securitygroups_rpc [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Init firewall settings (driver=nsxv3) {{(pid=69728) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 621.374163] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69728) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 621.374375] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] RPC agent_id: nsxm-l-01a.corp.local [ 621.376648] env[69728]: DEBUG dogpile.cache.region [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.376779] env[69728]: DEBUG dogpile.lock [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.376882] env[69728]: DEBUG dogpile.lock [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.377009] env[69728]: DEBUG dogpile.lock [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.377144] env[69728]: DEBUG dogpile.cache.region [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.377219] env[69728]: DEBUG dogpile.lock [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.377342] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.413462] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Session token - acquiring [ 621.415155] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.415388] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.415503] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.415936] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.425816] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.683861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 621.705483] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.705651] env[69728]: DEBUG dogpile.cache.region [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Cache value generated in 0.328 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 621.705738] env[69728]: DEBUG dogpile.lock [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.705860] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Activating Policy API Provider. [ 621.706075] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Looking for the default Infrastructure Rules. [ 621.762743] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Looking for the Default Layer3 Logged Drop Section. [ 621.774564] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 621.775018] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.775212] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.775325] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.775593] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.775912] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.290243] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.792473] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.295339] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Inventory metadata is going to be refreshed. [ 623.295507] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 623.982991] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.983406] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.983406] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.983656] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.094706] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 624.095615] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.096571] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 624.115187] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.115368] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.115488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.115740] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.115864] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.116016] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 624.116136] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 624.116272] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 624.135622] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.135840] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.135882] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.136142] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.136314] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.136462] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 624.155268] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.155540] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.155611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.155869] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.156017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.156164] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 624.178895] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.179183] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.179183] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.179476] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.179623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.179775] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 624.179881] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 624.179985] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 624.199187] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.199402] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.199536] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.199816] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.199946] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.200105] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 624.200282] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 624.200403] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 624.218741] env[69728]: DEBUG networking_nsxv3.common.locking [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.219019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.219019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.219281] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.219434] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.219596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 624.219704] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 624.219808] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Inventory metadata have been refreshed. [ 624.219907] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Dryrun:True. Metadata refresh completed. [ 624.220034] env[69728]: DEBUG oslo_concurrency.lockutils [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Releasing lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.221679] env[69728]: INFO neutron.agent.agent_extensions_manager [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Loaded agent extensions: [] [ 624.222397] env[69728]: DEBUG neutron_lib.callbacks.manager [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69728) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 624.267965] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent RPC Daemon Started! [ 624.268142] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:0 started [ 624.268324] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent out of sync with plugin! [ 629.223138] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 629.223410] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 634.224860] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 634.225228] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 638.133494] env[69728]: INFO networking_nsxv3.common.synchronization [None req-904fde40-8f50-4f96-b373-5b2e98421a4e demo admin] Enqueued Resource ID: 4ce3a781-ffbb-4660-ba0f-30297f4e3abd with Priority: HIGHEST for action security_group_rules [ 638.134032] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ce3a781-ffbb-4660-ba0f-30297f4e3abd with Priority: HIGHEST for action security_group_rules [ 638.134338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ce3a781-ffbb-4660-ba0f-30297f4e3abd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.134465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ce3a781-ffbb-4660-ba0f-30297f4e3abd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.134529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ce3a781-ffbb-4660-ba0f-30297f4e3abd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.134874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ce3a781-ffbb-4660-ba0f-30297f4e3abd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.134962] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ce3a781-ffbb-4660-ba0f-30297f4e3abd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.660842] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.661134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.661134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.661273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.661340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.661451] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ce3a781-ffbb-4660-ba0f-30297f4e3abd already deleted. [ 638.661509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ce3a781-ffbb-4660-ba0f-30297f4e3abd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.135520] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 643.135520] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 648.136618] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 648.136618] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 653.137434] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 653.137751] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 658.138934] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 658.138934] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 663.143416] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 663.143771] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 664.578461] env[69728]: INFO networking_nsxv3.common.synchronization [None req-af91d9bd-fb2b-421a-b922-646b9872839c None None] Enqueued Resource ID: 96f352c1-aee9-4731-bb84-211a9ef2741a with Priority: HIGHEST for action port [ 664.578708] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96f352c1-aee9-4731-bb84-211a9ef2741a with Priority: HIGHEST for action port [ 664.579653] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-96f352c1-aee9-4731-bb84-211a9ef2741a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.579653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96f352c1-aee9-4731-bb84-211a9ef2741a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.579653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96f352c1-aee9-4731-bb84-211a9ef2741a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.579832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96f352c1-aee9-4731-bb84-211a9ef2741a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.579832] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96f352c1-aee9-4731-bb84-211a9ef2741a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.082529] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96f352c1-aee9-4731-bb84-211a9ef2741a [ 665.082973] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.083113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.083314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.083541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.083641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.083751] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96f352c1-aee9-4731-bb84-211a9ef2741a already deleted. [ 665.083866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96f352c1-aee9-4731-bb84-211a9ef2741a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.498916] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9fa81020-3a97-4e71-84ce-ce5b23582552 None None] Enqueued Resource ID: 6f89bafe-b229-4380-ae53-b618a76f2798 with Priority: HIGHEST for action port [ 666.502082] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f89bafe-b229-4380-ae53-b618a76f2798 with Priority: HIGHEST for action port [ 666.502082] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f89bafe-b229-4380-ae53-b618a76f2798 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.502082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f89bafe-b229-4380-ae53-b618a76f2798" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.502082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f89bafe-b229-4380-ae53-b618a76f2798" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.502082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f89bafe-b229-4380-ae53-b618a76f2798" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.502082] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f89bafe-b229-4380-ae53-b618a76f2798',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.520184] env[69728]: INFO networking_nsxv3.common.synchronization [None req-94be1b31-26d0-4b26-bf06-03a544e110bb tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 666.522457] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 666.524104] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.524234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.524300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.524708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.524708] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.593464] env[69728]: INFO networking_nsxv3.common.synchronization [None req-4d057767-25d7-4a64-b5a3-d6109c280eab tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 666.593563] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 666.593852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.593947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.004574] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6f89bafe-b229-4380-ae53-b618a76f2798 [ 667.004574] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.004574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.004574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.004776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.004804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.004905] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6f89bafe-b229-4380-ae53-b618a76f2798 already deleted. [ 667.004981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f89bafe-b229-4380-ae53-b618a76f2798" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.019431] env[69728]: INFO networking_nsxv3.common.synchronization [None req-fe4e9b46-8983-4dac-b931-100556ba9657 None None] Enqueued Resource ID: 5542741a-c8d4-4034-a75f-8e39cab28933 with Priority: HIGHEST for action port [ 667.019431] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5542741a-c8d4-4034-a75f-8e39cab28933 with Priority: HIGHEST for action port [ 667.019805] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5542741a-c8d4-4034-a75f-8e39cab28933 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.019858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5542741a-c8d4-4034-a75f-8e39cab28933" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.019990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5542741a-c8d4-4034-a75f-8e39cab28933" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.020376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5542741a-c8d4-4034-a75f-8e39cab28933" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.020376] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5542741a-c8d4-4034-a75f-8e39cab28933',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.049245] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.049245] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 already deleted. [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.049245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.049245] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.225331] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.225331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.225529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.225612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.225835] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.524200] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5542741a-c8d4-4034-a75f-8e39cab28933 [ 667.524458] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.524458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.524583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.524772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.526558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.526558] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5542741a-c8d4-4034-a75f-8e39cab28933 already deleted. [ 667.526558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5542741a-c8d4-4034-a75f-8e39cab28933" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.568806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.568806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.568806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.568806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.568806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.568806] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 already deleted. [ 667.568806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.728916] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.233430] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.741225] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 668.741225] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 668.791135] env[69728]: INFO networking_nsxv3.common.synchronization [None req-aaf94f30-f84d-4ad4-9fac-da974f76ede1 None None] Enqueued Resource ID: b0ed24a4-aac5-4105-be87-e7fd3be834ac with Priority: HIGHEST for action port [ 668.791937] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0ed24a4-aac5-4105-be87-e7fd3be834ac with Priority: HIGHEST for action port [ 668.795240] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0ed24a4-aac5-4105-be87-e7fd3be834ac taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.795240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0ed24a4-aac5-4105-be87-e7fd3be834ac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.795240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0ed24a4-aac5-4105-be87-e7fd3be834ac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.795240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0ed24a4-aac5-4105-be87-e7fd3be834ac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.795240] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0ed24a4-aac5-4105-be87-e7fd3be834ac',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.250047] env[69728]: INFO networking_nsxv3.common.synchronization [None req-f115af90-c58e-4c55-af44-93597721363a None None] Enqueued Resource ID: b8ce7136-de68-4955-82d9-ac9761c97d0f with Priority: HIGHEST for action port [ 669.257239] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ce7136-de68-4955-82d9-ac9761c97d0f with Priority: HIGHEST for action port [ 669.257239] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8ce7136-de68-4955-82d9-ac9761c97d0f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.257642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8ce7136-de68-4955-82d9-ac9761c97d0f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.257825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8ce7136-de68-4955-82d9-ac9761c97d0f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.258397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8ce7136-de68-4955-82d9-ac9761c97d0f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.258648] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ce7136-de68-4955-82d9-ac9761c97d0f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.297614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0ed24a4-aac5-4105-be87-e7fd3be834ac [ 669.297614] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.297614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.297614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.297614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.297614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.297614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0ed24a4-aac5-4105-be87-e7fd3be834ac already deleted. [ 669.297614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0ed24a4-aac5-4105-be87-e7fd3be834ac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.543081] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.543350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.543350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.543809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.558142] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 669.562712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.562908] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 669.583173] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.583173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.583173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.583173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.583173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.583173] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 669.583173] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.583173] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 669.603363] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.603363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.603363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.603363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.603363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.603363] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 669.622651] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.622800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.622869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.623094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.623199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.623305] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 669.646649] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.647349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.647349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.647349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.647349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.647349] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 669.647349] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.647848] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 669.663756] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.663970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.663970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.664209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.664280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.664495] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 669.664495] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.664575] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 669.683616] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.683791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.683873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.684060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.684474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.684605] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 669.684681] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 669.684751] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 669.684817] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 669.684893] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 669.684952] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 669.685024] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 669.685291] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 669.685363] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 669.685411] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 669.703738] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.703738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.703738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.703738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.703738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.703738] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 669.724351] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.724351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.724351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.725139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.725292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.743754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.761597] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8ce7136-de68-4955-82d9-ac9761c97d0f [ 669.761826] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.761963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.762041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.762247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.762331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.762421] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8ce7136-de68-4955-82d9-ac9761c97d0f already deleted. [ 669.762499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8ce7136-de68-4955-82d9-ac9761c97d0f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.955704] env[69728]: INFO networking_nsxv3.common.synchronization [None req-25ca5f7f-ef04-448d-8b95-56b4c977092d None None] Enqueued Resource ID: 842f855f-0841-4ef6-88a9-b4ab123edf7b with Priority: HIGHEST for action port [ 669.955968] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 842f855f-0841-4ef6-88a9-b4ab123edf7b with Priority: HIGHEST for action port [ 669.956544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-842f855f-0841-4ef6-88a9-b4ab123edf7b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.956690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-842f855f-0841-4ef6-88a9-b4ab123edf7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.956740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-842f855f-0841-4ef6-88a9-b4ab123edf7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.956972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-842f855f-0841-4ef6-88a9-b4ab123edf7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.957505] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('842f855f-0841-4ef6-88a9-b4ab123edf7b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.077428] env[69728]: INFO networking_nsxv3.common.synchronization [None req-f99c3f7e-7150-477a-9c44-e13b4818cbbf None None] Enqueued Resource ID: 3eee1f33-3ec6-482d-ad5f-712b2d4395ff with Priority: HIGHEST for action port [ 670.077691] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eee1f33-3ec6-482d-ad5f-712b2d4395ff with Priority: HIGHEST for action port [ 670.078831] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eee1f33-3ec6-482d-ad5f-712b2d4395ff taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.078831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eee1f33-3ec6-482d-ad5f-712b2d4395ff" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.078831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eee1f33-3ec6-482d-ad5f-712b2d4395ff" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.078831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eee1f33-3ec6-482d-ad5f-712b2d4395ff" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.078831] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eee1f33-3ec6-482d-ad5f-712b2d4395ff',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.459136] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 842f855f-0841-4ef6-88a9-b4ab123edf7b [ 670.459359] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.459490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.459848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.460315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.460315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.460315] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:842f855f-0841-4ef6-88a9-b4ab123edf7b already deleted. [ 670.460450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-842f855f-0841-4ef6-88a9-b4ab123edf7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.581811] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3eee1f33-3ec6-482d-ad5f-712b2d4395ff [ 670.582194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.582743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.582892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.583831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.583912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.584169] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3eee1f33-3ec6-482d-ad5f-712b2d4395ff already deleted. [ 670.584169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eee1f33-3ec6-482d-ad5f-712b2d4395ff" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.135934] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7f9c9bbd-de2a-4401-a6b3-013280e782fa None None] Enqueued Resource ID: c943d664-692b-41ab-985e-d42d408d8f8a with Priority: HIGHEST for action port [ 671.135934] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c943d664-692b-41ab-985e-d42d408d8f8a with Priority: HIGHEST for action port [ 671.135934] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c943d664-692b-41ab-985e-d42d408d8f8a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.135934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c943d664-692b-41ab-985e-d42d408d8f8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.135934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c943d664-692b-41ab-985e-d42d408d8f8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.135934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c943d664-692b-41ab-985e-d42d408d8f8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.135934] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c943d664-692b-41ab-985e-d42d408d8f8a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.477852] env[69728]: INFO networking_nsxv3.common.synchronization [None req-df4e5cde-6d1e-46d4-ad3b-b8bd5ac06144 None None] Enqueued Resource ID: 15f90595-42fc-4147-8acf-6e185d2b5396 with Priority: HIGHEST for action port [ 671.478116] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15f90595-42fc-4147-8acf-6e185d2b5396 with Priority: HIGHEST for action port [ 671.478673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-15f90595-42fc-4147-8acf-6e185d2b5396 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.479128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15f90595-42fc-4147-8acf-6e185d2b5396" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.479128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15f90595-42fc-4147-8acf-6e185d2b5396" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.479128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15f90595-42fc-4147-8acf-6e185d2b5396" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.479216] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15f90595-42fc-4147-8acf-6e185d2b5396',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.638460] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c943d664-692b-41ab-985e-d42d408d8f8a [ 671.638460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.638460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.638460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.638460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.638460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.638460] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c943d664-692b-41ab-985e-d42d408d8f8a already deleted. [ 671.638460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c943d664-692b-41ab-985e-d42d408d8f8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.982581] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15f90595-42fc-4147-8acf-6e185d2b5396 [ 671.982825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.982974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.983057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.983272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.983363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.983460] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15f90595-42fc-4147-8acf-6e185d2b5396 already deleted. [ 671.983542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15f90595-42fc-4147-8acf-6e185d2b5396" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.244520] env[69728]: INFO networking_nsxv3.common.synchronization [None req-bf15b530-5c6e-4219-b725-c5ca96e7b520 None None] Enqueued Resource ID: 5f2e61be-e565-4d6f-b6ac-1480b8861082 with Priority: HIGHEST for action port [ 672.244763] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f2e61be-e565-4d6f-b6ac-1480b8861082 with Priority: HIGHEST for action port [ 672.244941] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f2e61be-e565-4d6f-b6ac-1480b8861082 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.245735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f2e61be-e565-4d6f-b6ac-1480b8861082" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.245821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f2e61be-e565-4d6f-b6ac-1480b8861082" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.246081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f2e61be-e565-4d6f-b6ac-1480b8861082" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.246164] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f2e61be-e565-4d6f-b6ac-1480b8861082',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.635657] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e4fd7d3b-4935-495a-8698-fd2e3abd6536 None None] Enqueued Resource ID: 36ebd782-239d-4194-89dc-1919cf5e580d with Priority: HIGHEST for action port [ 672.635657] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36ebd782-239d-4194-89dc-1919cf5e580d with Priority: HIGHEST for action port [ 672.636900] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-36ebd782-239d-4194-89dc-1919cf5e580d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.636900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36ebd782-239d-4194-89dc-1919cf5e580d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.636900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36ebd782-239d-4194-89dc-1919cf5e580d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.636900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36ebd782-239d-4194-89dc-1919cf5e580d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.636900] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36ebd782-239d-4194-89dc-1919cf5e580d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.748452] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f2e61be-e565-4d6f-b6ac-1480b8861082 [ 672.750082] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.750082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.750082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.750082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.750082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.750082] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f2e61be-e565-4d6f-b6ac-1480b8861082 already deleted. [ 672.750082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f2e61be-e565-4d6f-b6ac-1480b8861082" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.139548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36ebd782-239d-4194-89dc-1919cf5e580d [ 673.139856] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.140021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.140604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.140604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.140604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.140604] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36ebd782-239d-4194-89dc-1919cf5e580d already deleted. [ 673.140604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36ebd782-239d-4194-89dc-1919cf5e580d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.525454] env[69728]: INFO networking_nsxv3.common.synchronization [None req-dff9d733-dfd7-4e6c-b4c2-0e222d763e73 None None] Enqueued Resource ID: 8c0842d3-d5c0-415d-a055-7c46e3df469c with Priority: HIGHEST for action port [ 673.525454] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c0842d3-d5c0-415d-a055-7c46e3df469c with Priority: HIGHEST for action port [ 673.525821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c0842d3-d5c0-415d-a055-7c46e3df469c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.525984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c0842d3-d5c0-415d-a055-7c46e3df469c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.525984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c0842d3-d5c0-415d-a055-7c46e3df469c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.526554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c0842d3-d5c0-415d-a055-7c46e3df469c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.526554] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c0842d3-d5c0-415d-a055-7c46e3df469c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.031600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c0842d3-d5c0-415d-a055-7c46e3df469c [ 674.031839] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.031977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.032099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.032319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.032410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.032504] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c0842d3-d5c0-415d-a055-7c46e3df469c already deleted. [ 674.032580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c0842d3-d5c0-415d-a055-7c46e3df469c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.405010] env[69728]: INFO networking_nsxv3.common.synchronization [None req-4a2960fb-75e5-48db-8774-34afd02a9302 None None] Enqueued Resource ID: 723e5fea-c549-44fb-bbac-88bd8d0bb232 with Priority: HIGHEST for action port [ 675.406100] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 723e5fea-c549-44fb-bbac-88bd8d0bb232 with Priority: HIGHEST for action port [ 675.406100] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-723e5fea-c549-44fb-bbac-88bd8d0bb232 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.406100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-723e5fea-c549-44fb-bbac-88bd8d0bb232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.406100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-723e5fea-c549-44fb-bbac-88bd8d0bb232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.406513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-723e5fea-c549-44fb-bbac-88bd8d0bb232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.406678] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('723e5fea-c549-44fb-bbac-88bd8d0bb232',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.908598] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 723e5fea-c549-44fb-bbac-88bd8d0bb232 [ 675.908716] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.908863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.908931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.909152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.909453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.909453] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:723e5fea-c549-44fb-bbac-88bd8d0bb232 already deleted. [ 675.909453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-723e5fea-c549-44fb-bbac-88bd8d0bb232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.222044] env[69728]: INFO networking_nsxv3.common.synchronization [None req-d09867b9-cd82-4bef-ad44-2599356fcecc None None] Enqueued Resource ID: 8991ba78-5848-4ca7-ab8a-8282b1eff66f with Priority: HIGHEST for action port [ 676.222044] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8991ba78-5848-4ca7-ab8a-8282b1eff66f with Priority: HIGHEST for action port [ 676.222044] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8991ba78-5848-4ca7-ab8a-8282b1eff66f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.222044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8991ba78-5848-4ca7-ab8a-8282b1eff66f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.222044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8991ba78-5848-4ca7-ab8a-8282b1eff66f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.222044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8991ba78-5848-4ca7-ab8a-8282b1eff66f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.222729] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8991ba78-5848-4ca7-ab8a-8282b1eff66f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.597290] env[69728]: INFO networking_nsxv3.common.synchronization [None req-db71a91a-7d05-487e-b9d2-ad6384ddb4ef None None] Enqueued Resource ID: 44a8cfb8-c452-4270-b093-cf613c787c1d with Priority: HIGHEST for action port [ 676.597609] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a8cfb8-c452-4270-b093-cf613c787c1d with Priority: HIGHEST for action port [ 676.598126] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-44a8cfb8-c452-4270-b093-cf613c787c1d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.598247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44a8cfb8-c452-4270-b093-cf613c787c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.598314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44a8cfb8-c452-4270-b093-cf613c787c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.598573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44a8cfb8-c452-4270-b093-cf613c787c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.599041] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44a8cfb8-c452-4270-b093-cf613c787c1d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.654229] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5cf111c7-a41a-4ca7-9794-0858f5ee9322 None None] Enqueued Resource ID: 3fb71a59-0882-4e67-8645-8cc89d11819f with Priority: HIGHEST for action port [ 676.654229] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb71a59-0882-4e67-8645-8cc89d11819f with Priority: HIGHEST for action port [ 676.654229] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fb71a59-0882-4e67-8645-8cc89d11819f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.654229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fb71a59-0882-4e67-8645-8cc89d11819f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.654229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fb71a59-0882-4e67-8645-8cc89d11819f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.655045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fb71a59-0882-4e67-8645-8cc89d11819f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.655263] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fb71a59-0882-4e67-8645-8cc89d11819f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.727578] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8991ba78-5848-4ca7-ab8a-8282b1eff66f [ 676.727578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.727578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.727578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.727578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.727578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.727578] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8991ba78-5848-4ca7-ab8a-8282b1eff66f already deleted. [ 676.727578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8991ba78-5848-4ca7-ab8a-8282b1eff66f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.103493] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44a8cfb8-c452-4270-b093-cf613c787c1d [ 677.103818] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.103894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.103960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.104160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.104256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.104349] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44a8cfb8-c452-4270-b093-cf613c787c1d already deleted. [ 677.104431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44a8cfb8-c452-4270-b093-cf613c787c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.159022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fb71a59-0882-4e67-8645-8cc89d11819f [ 677.159252] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.159383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.159628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.159687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.160141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.160141] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fb71a59-0882-4e67-8645-8cc89d11819f already deleted. [ 677.160141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fb71a59-0882-4e67-8645-8cc89d11819f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.717478] env[69728]: INFO networking_nsxv3.common.synchronization [None req-bd61b757-2696-413b-9a20-e1d0940963eb None None] Enqueued Resource ID: 5f758224-c8e2-417a-8bd9-cb61aba60b83 with Priority: HIGHEST for action port [ 677.717478] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f758224-c8e2-417a-8bd9-cb61aba60b83 with Priority: HIGHEST for action port [ 677.717478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f758224-c8e2-417a-8bd9-cb61aba60b83 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.717478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f758224-c8e2-417a-8bd9-cb61aba60b83" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.717478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f758224-c8e2-417a-8bd9-cb61aba60b83" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.717478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f758224-c8e2-417a-8bd9-cb61aba60b83" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.717478] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f758224-c8e2-417a-8bd9-cb61aba60b83',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.219031] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f758224-c8e2-417a-8bd9-cb61aba60b83 [ 678.219031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.219031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.219031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.219031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.219031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.219031] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f758224-c8e2-417a-8bd9-cb61aba60b83 already deleted. [ 678.219031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f758224-c8e2-417a-8bd9-cb61aba60b83" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.624308] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c39d0c0-6873-4265-9b72-7e785bcfc248 req-e1a4e4d3-09fe-4127-b49c-7924a37e039a tempest-DeleteServersAdminTestJSON-668290985 tempest-DeleteServersAdminTestJSON-668290985-project-member] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 678.624812] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 678.625131] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.626512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.626614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.626871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.627052] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.627177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.627238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.627442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.627569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.627666] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.686025] env[69728]: INFO networking_nsxv3.common.synchronization [None req-72e1d3d9-bf4a-4752-9bc8-4629a5ef88bd None None] Enqueued Resource ID: 2958cf92-b229-4d76-80dc-81be39a441c6 with Priority: HIGHEST for action port [ 678.687099] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2958cf92-b229-4d76-80dc-81be39a441c6 with Priority: HIGHEST for action port [ 678.689281] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2958cf92-b229-4d76-80dc-81be39a441c6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.689281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2958cf92-b229-4d76-80dc-81be39a441c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.689281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2958cf92-b229-4d76-80dc-81be39a441c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.689281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2958cf92-b229-4d76-80dc-81be39a441c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.689281] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2958cf92-b229-4d76-80dc-81be39a441c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.133784] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.133784] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.133784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.135366] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f already deleted. [ 679.135366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.193404] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2958cf92-b229-4d76-80dc-81be39a441c6 [ 679.193528] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.193778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.193778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.194286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.194376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.194478] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2958cf92-b229-4d76-80dc-81be39a441c6 already deleted. [ 679.194561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2958cf92-b229-4d76-80dc-81be39a441c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.727438] env[69728]: INFO networking_nsxv3.common.synchronization [None req-0b0b40b7-fe48-4192-a6fa-d1b728f74fd4 None None] Enqueued Resource ID: e218e815-65a8-476e-8a70-4f441707d4e6 with Priority: HIGHEST for action port [ 679.727708] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e218e815-65a8-476e-8a70-4f441707d4e6 with Priority: HIGHEST for action port [ 679.728385] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e218e815-65a8-476e-8a70-4f441707d4e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.728449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e218e815-65a8-476e-8a70-4f441707d4e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.728502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e218e815-65a8-476e-8a70-4f441707d4e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.730300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e218e815-65a8-476e-8a70-4f441707d4e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.730300] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e218e815-65a8-476e-8a70-4f441707d4e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.753995] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.757121] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.757121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.757121] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.757121] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.757121] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.757121] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.757121] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.757121] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.757121] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.775535] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.776743] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.776743] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.776743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.776743] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-2a251fbc-3688-4543-8e8e-21234871ddad taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.776743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.776743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.777011] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.777041] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a251fbc-3688-4543-8e8e-21234871ddad',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.922116] env[69728]: INFO networking_nsxv3.common.synchronization [None req-035ec840-6e9e-49f7-92cd-4aa43501322c None None] Enqueued Resource ID: 330480fc-2952-4655-81dd-654a09c9ae05 with Priority: HIGHEST for action port [ 679.922414] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 330480fc-2952-4655-81dd-654a09c9ae05 with Priority: HIGHEST for action port [ 679.923595] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-330480fc-2952-4655-81dd-654a09c9ae05 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.923760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-330480fc-2952-4655-81dd-654a09c9ae05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.923818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-330480fc-2952-4655-81dd-654a09c9ae05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.924098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-330480fc-2952-4655-81dd-654a09c9ae05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.924195] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('330480fc-2952-4655-81dd-654a09c9ae05',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.168196] env[69728]: INFO networking_nsxv3.common.synchronization [req-59c8dc0e-1048-4418-8131-45ae33b79f3b req-d766bd0b-1604-4cce-a4a6-a0a177f85bdf tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 680.168699] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 680.169025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.169152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.169246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.169460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.169615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.169707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.169770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.169917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.170009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.170099] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.235031] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e218e815-65a8-476e-8a70-4f441707d4e6 [ 680.235337] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.235490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.235567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.237566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.237566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.237566] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e218e815-65a8-476e-8a70-4f441707d4e6 already deleted. [ 680.237566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e218e815-65a8-476e-8a70-4f441707d4e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.284991] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.284991] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 2a251fbc-3688-4543-8e8e-21234871ddad not found, creating... [ 680.284991] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.284991] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.285443] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.285443] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.285812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.285812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.285954] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.286108] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 2a251fbc-3688-4543-8e8e-21234871ddad is going to be created. [ 680.306723] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.307034] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.307092] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.309391] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.309391] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.309391] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.428911] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 330480fc-2952-4655-81dd-654a09c9ae05 [ 680.429198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.429338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.429408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.433071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.433197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.433312] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:330480fc-2952-4655-81dd-654a09c9ae05 already deleted. [ 680.434196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-330480fc-2952-4655-81dd-654a09c9ae05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.673571] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.673571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.673571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.673571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.673571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.673802] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.673973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.673973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.674055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.674344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.674344] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 already deleted. [ 680.674344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.699219] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.699219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.699219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.699219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.699462] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.699524] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.699617] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.699827] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.699961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.700540] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.701187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.701187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.701187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.701187] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.701187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.701187] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.720115] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.720292] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.720541] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.720743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.722043] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-b8b06536-dbc7-44cb-97c9-7f5d7e652571 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.722043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.722043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.722043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.722270] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8b06536-dbc7-44cb-97c9-7f5d7e652571',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.225124] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.225327] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.225327] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.225627] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.225843] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.225957] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port b8b06536-dbc7-44cb-97c9-7f5d7e652571 not found, creating... [ 681.226196] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.226347] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.226467] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.226719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.226863] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.227158] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.227305] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.227732] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.227732] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.227802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.229350] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: b8b06536-dbc7-44cb-97c9-7f5d7e652571 is going to be created. [ 681.252788] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.253599] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.253599] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.253599] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.253749] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.253975] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.431296] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c39d0c0-6873-4265-9b72-7e785bcfc248 req-8ac8e295-c630-4fe0-b077-379bd154b601 service nova] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_rules [ 681.431296] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c39d0c0-6873-4265-9b72-7e785bcfc248 req-8ac8e295-c630-4fe0-b077-379bd154b601 service nova] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 681.431296] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c39d0c0-6873-4265-9b72-7e785bcfc248 req-8ac8e295-c630-4fe0-b077-379bd154b601 service nova] Enqueued Resource ID: 2a251fbc-3688-4543-8e8e-21234871ddad with Priority: HIGHEST for action port [ 681.431463] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_rules [ 681.431597] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 681.431741] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a251fbc-3688-4543-8e8e-21234871ddad with Priority: HIGHEST for action port [ 681.432691] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.432691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.432691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.432859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.432859] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.433656] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.433766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.433828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.433991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.434144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.434234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.434687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.434687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.434687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.434687] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.436991] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a251fbc-3688-4543-8e8e-21234871ddad taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.437107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.437217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.437325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.437418] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a251fbc-3688-4543-8e8e-21234871ddad',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.821712] env[69728]: INFO networking_nsxv3.common.synchronization [None req-125829c1-08ce-4643-83f0-3a11b3a0c2f6 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 681.822775] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 681.823501] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.823697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.823697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.824802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.824802] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.943921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.943921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.961023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a251fbc-3688-4543-8e8e-21234871ddad with status ACTIVE [ 681.961023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.961023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.961023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.961023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.961023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a251fbc-3688-4543-8e8e-21234871ddad is going to be updated. [ 681.966958] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.987413] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.987560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.987726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.987904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.988739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.989462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a251fbc-3688-4543-8e8e-21234871ddad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.147039] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9bd1a68b-1b5a-4d8c-bccb-41d35dcfd678 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 682.147550] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 682.147847] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.148036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.232722] env[69728]: INFO networking_nsxv3.common.synchronization [req-9516b3cc-bafa-41cd-82cc-016ed209a942 req-07114a66-e182-454e-9f70-6905eb825cc6 tempest-ServerTagsTestJSON-1995299048 tempest-ServerTagsTestJSON-1995299048-project-member] Enqueued Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_members [ 682.234101] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_members [ 682.234101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.234101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.234101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.234101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.234101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.234369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.234369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.235784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.235784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.235784] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.345714] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.347994] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 already deleted. [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.347994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.347994] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.453972] env[69728]: INFO networking_nsxv3.common.synchronization [req-59c8dc0e-1048-4418-8131-45ae33b79f3b req-623d2b3a-b573-49c5-9fe4-e5494c95dc5f service nova] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 682.453972] env[69728]: INFO networking_nsxv3.common.synchronization [req-59c8dc0e-1048-4418-8131-45ae33b79f3b req-623d2b3a-b573-49c5-9fe4-e5494c95dc5f service nova] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 682.453972] env[69728]: INFO networking_nsxv3.common.synchronization [req-59c8dc0e-1048-4418-8131-45ae33b79f3b req-623d2b3a-b573-49c5-9fe4-e5494c95dc5f service nova] Enqueued Resource ID: b8b06536-dbc7-44cb-97c9-7f5d7e652571 with Priority: HIGHEST for action port [ 682.453972] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 682.453972] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 682.453972] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b06536-dbc7-44cb-97c9-7f5d7e652571 with Priority: HIGHEST for action port [ 682.453972] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.453972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.453972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.455363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.455593] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.458879] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.459872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.460075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.460367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.460745] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.460962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.461327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.464366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.464366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.464366] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.464366] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8b06536-dbc7-44cb-97c9-7f5d7e652571 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.464366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.464366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.464366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.464366] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8b06536-dbc7-44cb-97c9-7f5d7e652571',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.469689] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.740392] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.740555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.740627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.744145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.744145] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e37c97c7-2869-4890-a474-cbf964f85643 already deleted. [ 682.744145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.869264] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.869264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.869264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.869264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.869264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.869264] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 already deleted. [ 682.869264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.965667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.965667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.966884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8b06536-dbc7-44cb-97c9-7f5d7e652571 with status ACTIVE [ 682.970171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.970171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.970171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.970171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.970171] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8b06536-dbc7-44cb-97c9-7f5d7e652571 is going to be updated. [ 682.970704] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.974455] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.974772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.975116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.978241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.978345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.978447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be created. [ 682.996061] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.996228] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.996228] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.996423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.996567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.996721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8b06536-dbc7-44cb-97c9-7f5d7e652571" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.017248] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.017509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.017626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.017935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.018156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.029166] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: UNINITIALIZED for 2s [ 683.456200] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-456 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.456503] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-456" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.456503] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-456" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.456862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-456" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.457082] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.457244] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.457362] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.457655] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.457802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.458023] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.458702] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.458828] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.458962] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.459226] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.459226] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.459316] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.469965] env[69728]: INFO networking_nsxv3.common.synchronization [None req-fa1abad1-43eb-4d90-987f-e090437ebdcc None None] Enqueued Resource ID: a573faac-9ed0-43d2-8198-75af6b5350c1 with Priority: HIGHEST for action port [ 683.470235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a573faac-9ed0-43d2-8198-75af6b5350c1 with Priority: HIGHEST for action port [ 683.470725] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a573faac-9ed0-43d2-8198-75af6b5350c1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.470844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a573faac-9ed0-43d2-8198-75af6b5350c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.470915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a573faac-9ed0-43d2-8198-75af6b5350c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.471157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a573faac-9ed0-43d2-8198-75af6b5350c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.471243] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a573faac-9ed0-43d2-8198-75af6b5350c1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.474287] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.476996] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.477069] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.481058] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.481058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-456" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.481058] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.481058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.481058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.481058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.481058] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7e7a49-9e73-45d2-a88c-3d15d6f96b97',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.974826] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a573faac-9ed0-43d2-8198-75af6b5350c1 [ 683.975079] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.975227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.975299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.975625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.975625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.975726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a573faac-9ed0-43d2-8198-75af6b5350c1 already deleted. [ 683.975793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a573faac-9ed0-43d2-8198-75af6b5350c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.976144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.976300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.976300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.977684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.977684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.977684] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be created. [ 683.982278] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.982278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.982278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.982278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.982278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.982278] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 not found, creating... [ 683.982278] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.982278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.982278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.982645] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.982645] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.982893] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.983849] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.983994] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.984261] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.984426] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.984600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 is going to be created. [ 684.003863] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.004119] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.004278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.004547] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.005722] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.005722] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.008250] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.008376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.008643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.008708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.008928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.018378] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: UNINITIALIZED for 2s [ 684.828932] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7ecf63fd-24d9-4475-aa5a-5d0e239ea3fd None None] Enqueued Resource ID: cd0a680a-604c-4b8c-98c5-5962e7f650ed with Priority: HIGHEST for action port [ 684.829231] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd0a680a-604c-4b8c-98c5-5962e7f650ed with Priority: HIGHEST for action port [ 684.829768] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd0a680a-604c-4b8c-98c5-5962e7f650ed taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.829888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd0a680a-604c-4b8c-98c5-5962e7f650ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.829959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd0a680a-604c-4b8c-98c5-5962e7f650ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.830231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd0a680a-604c-4b8c-98c5-5962e7f650ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.830316] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd0a680a-604c-4b8c-98c5-5962e7f650ed',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.039512] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 685.039762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.039932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.040170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.040363] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.040781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.040868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.040954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.041056] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.285695] env[69728]: INFO networking_nsxv3.common.synchronization [req-9516b3cc-bafa-41cd-82cc-016ed209a942 req-e67a0d47-e135-43ea-9f14-bb84c5e6d72a service nova] Enqueued Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_rules [ 685.285695] env[69728]: INFO networking_nsxv3.common.synchronization [req-9516b3cc-bafa-41cd-82cc-016ed209a942 req-e67a0d47-e135-43ea-9f14-bb84c5e6d72a service nova] Enqueued Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_members [ 685.285695] env[69728]: INFO networking_nsxv3.common.synchronization [req-9516b3cc-bafa-41cd-82cc-016ed209a942 req-e67a0d47-e135-43ea-9f14-bb84c5e6d72a service nova] Enqueued Resource ID: 9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 with Priority: HIGHEST for action port [ 685.285695] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_rules [ 685.285695] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_members [ 685.285951] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 with Priority: HIGHEST for action port [ 685.287074] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.287359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.287612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.288207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.288375] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.289315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.289551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.289703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.290085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.290332] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.290530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.290678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.290903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.291080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.291249] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.293679] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.293679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.293679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.294029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.297884] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b7e7a49-9e73-45d2-a88c-3d15d6f96b97',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.332729] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd0a680a-604c-4b8c-98c5-5962e7f650ed [ 685.333026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.333182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.333281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.333696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.333777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.333869] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd0a680a-604c-4b8c-98c5-5962e7f650ed already deleted. [ 685.335025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd0a680a-604c-4b8c-98c5-5962e7f650ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.546692] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.546692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.546861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.546991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.547172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.547294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.547553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.547624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.547658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.548036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.548036] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.548036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.548201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.548275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.548425] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.548530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.548596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.549020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.549020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.549020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.553070] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.795951] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.797258] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.797393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.798932] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 with status ACTIVE [ 685.799148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.799271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.799353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.800667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.800667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.800667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.801022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b7e7a49-9e73-45d2-a88c-3d15d6f96b97 is going to be updated. [ 685.822629] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.822862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.822862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.823145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.823299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.823359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b7e7a49-9e73-45d2-a88c-3d15d6f96b97" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.029388] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 686.029672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.029921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.030330] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.030940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.030940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.030940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.030940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.031180] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.057314] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e88d88-3454-4e14-8364-c48e1d31646f: rpc.has_security_group_logging(os_id): False [ 686.070652] env[69728]: INFO networking_nsxv3.common.synchronization [None req-2b238989-572a-4c41-8081-4f06be2232b5 None None] Enqueued Resource ID: 350848a6-eb47-4aac-a00d-80f68654c6c5 with Priority: HIGHEST for action port [ 686.071149] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 350848a6-eb47-4aac-a00d-80f68654c6c5 with Priority: HIGHEST for action port [ 686.071459] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-350848a6-eb47-4aac-a00d-80f68654c6c5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.073752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-350848a6-eb47-4aac-a00d-80f68654c6c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.073752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-350848a6-eb47-4aac-a00d-80f68654c6c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.073752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-350848a6-eb47-4aac-a00d-80f68654c6c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.073752] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('350848a6-eb47-4aac-a00d-80f68654c6c5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.076746] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.076895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.077874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.078226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.078342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.078623] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.078750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.078806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.078977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.079098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.079296] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.079420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.079486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.079630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.079719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.079941] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.080069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.080139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.080307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.080391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.080480] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be created. [ 686.142235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.142235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.143498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.143945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.144181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.162819] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: IN_PROGRESS for 2s [ 686.299669] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.535560] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.584862] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 350848a6-eb47-4aac-a00d-80f68654c6c5 [ 686.585603] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.585603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.585603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.585816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.585903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.585999] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:350848a6-eb47-4aac-a00d-80f68654c6c5 already deleted. [ 686.586089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-350848a6-eb47-4aac-a00d-80f68654c6c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.802703] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.803483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.804055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.804324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.804437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.804542] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e37c97c7-2869-4890-a474-cbf964f85643 is going to be created. [ 686.831451] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.831451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.831451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.831451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.831451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.838579] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e37c97c7-2869-4890-a474-cbf964f85643 in Status: UNINITIALIZED for 2s [ 687.010150] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e5473e12-c52a-4147-96de-3b36fb012ec0 None None] Enqueued Resource ID: 70411282-f2e2-42c9-89f3-c1c8c0e74ce1 with Priority: HIGHEST for action port [ 687.010150] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70411282-f2e2-42c9-89f3-c1c8c0e74ce1 with Priority: HIGHEST for action port [ 687.011722] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-70411282-f2e2-42c9-89f3-c1c8c0e74ce1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.011722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70411282-f2e2-42c9-89f3-c1c8c0e74ce1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.011722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70411282-f2e2-42c9-89f3-c1c8c0e74ce1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.014339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70411282-f2e2-42c9-89f3-c1c8c0e74ce1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.014339] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70411282-f2e2-42c9-89f3-c1c8c0e74ce1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.040366] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dafae610-4861-4852-9c85-d723484b91f0: rpc.has_security_group_logging(os_id): False [ 687.063356] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.063761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.063761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.063982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.064115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.064493] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.064585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.064666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.064797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.064946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.064999] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be created. [ 687.130340] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.130340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.130492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.130736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.130804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.144394] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 687.370023] env[69728]: INFO networking_nsxv3.common.synchronization [req-669f82a2-832c-453e-9087-c6d657d7a42e req-129c8878-7d65-4d38-bf63-bfcaa4619f75 tempest-ServerExternalEventsTest-1550345325 tempest-ServerExternalEventsTest-1550345325-project-member] Enqueued Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_members [ 687.370488] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_members [ 687.370787] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.370908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.370975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.372440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.372558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.372670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.372779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.372912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.372995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.373101] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.515410] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70411282-f2e2-42c9-89f3-c1c8c0e74ce1 [ 687.515699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.515842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.515911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.516211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.516279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.516319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70411282-f2e2-42c9-89f3-c1c8c0e74ce1 already deleted. [ 687.516400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70411282-f2e2-42c9-89f3-c1c8c0e74ce1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.650543] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6f056a60-1d8b-4d52-adfb-adc4d6ea7475 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_rules [ 687.651047] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_rules [ 687.651380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.651490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.651582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.651793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.651875] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.735016] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9bfc5767-5d3b-492a-bc94-f8b3f7a72945 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_rules [ 687.735286] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_rules [ 687.735850] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.735948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.877575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.877575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.877575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.877575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.878640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.878640] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.878640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.878640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.878929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.878929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.879074] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c07c53b9-b92a-425d-8250-b7f598ffd660 already deleted. [ 687.879181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.017685] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.017961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.018108] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.018384] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.018689] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.019220] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.019220] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.021582] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.021751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.021967] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.022096] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.022207] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.022313] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.022420] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.022525] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.022656] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.040701] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.040950] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.041256] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.041488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.041836] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-23b665fe-17a0-4580-872b-e676f6c0245c taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.042058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.042214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.042536] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.042714] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b665fe-17a0-4580-872b-e676f6c0245c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.171230] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 688.173110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.173325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.173325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.173416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.173659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.173659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.173726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 already deleted. [ 688.173831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.173940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.174153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.174244] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.301848] env[69728]: INFO networking_nsxv3.common.synchronization [None req-2e45afd8-33ac-4906-ad07-60dc102cc62b tempest-VolumesAssistedSnapshotsTest-955716078 tempest-VolumesAssistedSnapshotsTest-955716078-project-member] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_rules [ 688.302097] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_rules [ 688.302415] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.302511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.302576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.302821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.302888] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.516490] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5d6f17b2-41a7-4744-905b-d44399d42399 tempest-ServersWithSpecificFlavorTestJSON-1321527697 tempest-ServersWithSpecificFlavorTestJSON-1321527697-project-member] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 688.518613] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 688.518613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.518613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.518613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.518613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.518613] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.548527] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.548527] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 23b665fe-17a0-4580-872b-e676f6c0245c not found, creating... [ 688.548527] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.548527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.548914] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.548914] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.548914] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.549757] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.549922] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.550079] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 23b665fe-17a0-4580-872b-e676f6c0245c is going to be created. [ 688.573905] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.573905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.573905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.573905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.573905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.573905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.634058] env[69728]: INFO networking_nsxv3.common.synchronization [None req-c1cfbe5e-c1aa-4b95-81be-b24b93ad19c9 tempest-VolumesAssistedSnapshotsTest-955716078 tempest-VolumesAssistedSnapshotsTest-955716078-project-member] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_rules [ 688.635341] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_rules [ 688.635341] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.635341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.698551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.698551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.698551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.698551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.698551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.698551] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 already deleted. [ 688.698551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.824467] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.824616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.824686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.825058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.825058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.825135] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb already deleted. [ 688.825166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.825291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.825484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.825573] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.831600] env[69728]: INFO networking_nsxv3.common.synchronization [None req-478bef0c-1bec-4262-b4a3-1e5fb613b8bf tempest-ServersWithSpecificFlavorTestJSON-1321527697 tempest-ServersWithSpecificFlavorTestJSON-1321527697-project-member] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 688.831600] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 688.831600] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.831600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.849273] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e37c97c7-2869-4890-a474-cbf964f85643 in Status: SUCCESS [ 688.849273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.849273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.849273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.849273] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.849273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.849771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.849771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.849771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.849771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.849891] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.042070] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.042329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.042329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.043405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.043534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.043633] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 already deleted. [ 689.043714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.043885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.044051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.044171] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.174222] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 689.178492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.348109] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.348238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.348308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.348544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.348597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.348707] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb already deleted. [ 689.350591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.352575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.352717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.354058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.354058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.354058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.354956] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.354956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.354956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.354956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.354956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.354956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.354956] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.565423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.565423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.565423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.565423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.565423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.565423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 already deleted. [ 689.565423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.861916] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e37c97c7-2869-4890-a474-cbf964f85643: rpc.has_security_group_logging(os_id): False [ 689.880485] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.880686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.881253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.881529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.881758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.881911] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.882078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.882368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.882368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.883349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883349] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.883349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.883349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.883349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.883349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883638] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.883997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.884147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.884891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.885171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.885210] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e37c97c7-2869-4890-a474-cbf964f85643 is going to be created. [ 689.941837] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.941837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.941837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.941837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.941837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.956674] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e37c97c7-2869-4890-a474-cbf964f85643 in Status: IN_PROGRESS for 2s [ 690.637176] env[69728]: INFO networking_nsxv3.common.synchronization [req-a12f2ac6-713b-4e26-b6b4-bb62b1b4bade req-a78ebbe8-5741-4b96-814b-f1d26157b586 tempest-MigrationsAdminTest-770467406 tempest-MigrationsAdminTest-770467406-project-member] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 690.638010] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 690.638331] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.638483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.638642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.638916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.639013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.642148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.642254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.642423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.642496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.642606] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.127923] env[69728]: INFO networking_nsxv3.common.synchronization [req-669f82a2-832c-453e-9087-c6d657d7a42e req-f4789953-9c52-472a-bc9e-9be46eda687b service nova] Enqueued Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_rules [ 691.128298] env[69728]: INFO networking_nsxv3.common.synchronization [req-669f82a2-832c-453e-9087-c6d657d7a42e req-f4789953-9c52-472a-bc9e-9be46eda687b service nova] Enqueued Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_members [ 691.128718] env[69728]: INFO networking_nsxv3.common.synchronization [req-669f82a2-832c-453e-9087-c6d657d7a42e req-f4789953-9c52-472a-bc9e-9be46eda687b service nova] Enqueued Resource ID: 23b665fe-17a0-4580-872b-e676f6c0245c with Priority: HIGHEST for action port [ 691.129311] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_rules [ 691.129533] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_members [ 691.129693] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b665fe-17a0-4580-872b-e676f6c0245c with Priority: HIGHEST for action port [ 691.130090] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.131309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.131309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.131309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.131309] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.132039] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.132328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.132453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.132675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.132924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.133109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.133205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.133618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.133765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.133896] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.135138] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b665fe-17a0-4580-872b-e676f6c0245c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.135258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.135331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.135493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.135573] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b665fe-17a0-4580-872b-e676f6c0245c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.146122] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.149021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.149021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 already deleted. [ 691.149021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.638712] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.638712] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.638712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.639818] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23b665fe-17a0-4580-872b-e676f6c0245c with status ACTIVE [ 691.639818] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.639818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.639818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.639818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.639818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.640017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.640064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.641159] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.641159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.641159] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23b665fe-17a0-4580-872b-e676f6c0245c is going to be updated. [ 691.662429] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.662429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.662429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.662429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.662429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.662429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b665fe-17a0-4580-872b-e676f6c0245c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.820576] env[69728]: INFO networking_nsxv3.common.synchronization [req-ba8ba5d9-f3f0-4904-aa48-a9a5461c3134 req-f8f9fa09-c595-46df-b527-a086a240d188 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 691.821347] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 691.821707] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.821845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.821916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.822173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.822801] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.822801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.823044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.823044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.823180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.823180] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.969499] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e37c97c7-2869-4890-a474-cbf964f85643 in Status: SUCCESS [ 691.969920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.141706] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.327341] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.327341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.327341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.327341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.327341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.327710] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.327710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.327710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.327853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.328058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.328058] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 already deleted. [ 692.328549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.652145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.652145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.652145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.652145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.652145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.652145] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c07c53b9-b92a-425d-8250-b7f598ffd660 is going to be created. [ 692.675222] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.675628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.675729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.676135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.676642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.687065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c07c53b9-b92a-425d-8250-b7f598ffd660 in Status: UNINITIALIZED for 2s [ 692.740525] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-140 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.740525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.740525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.740857] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.741509] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.742519] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.742694] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.742997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.743075] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.743293] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.743517] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.743517] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.743613] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.743714] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 692.743818] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.743982] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.762127] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.762313] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 692.762693] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.762693] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.762936] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-e08c0362-c640-4658-b7bb-a4309abee8c6 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.763609] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.763609] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.763786] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.763786] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e08c0362-c640-4658-b7bb-a4309abee8c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.032894] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a40df319-f512-4446-b155-67d96aa02723 None None] Enqueued Resource ID: bbdab810-8531-436e-b866-5ec607f62611 with Priority: HIGHEST for action port [ 693.032894] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdab810-8531-436e-b866-5ec607f62611 with Priority: HIGHEST for action port [ 693.032894] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbdab810-8531-436e-b866-5ec607f62611 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.032894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbdab810-8531-436e-b866-5ec607f62611" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.032894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbdab810-8531-436e-b866-5ec607f62611" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.032894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbdab810-8531-436e-b866-5ec607f62611" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.032894] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbdab810-8531-436e-b866-5ec607f62611',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.126028] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.127018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.127018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.127018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.127018] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.127219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.127219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.127372] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.127549] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.127753] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.127922] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.128133] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.128686] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.128777] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 693.128817] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.129211] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.146539] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.146701] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 693.146816] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.146987] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.147695] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.148423] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.148423] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.148757] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.149389] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179b35b3-b3fd-4ac1-95d3-b28fd07f45cf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.270589] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.270760] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.271080] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.271518] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.271605] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.271824] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port e08c0362-c640-4658-b7bb-a4309abee8c6 not found, creating... [ 693.272315] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.272726] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.272726] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.277101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.277325] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.277716] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.277895] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.278015] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.278281] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.279129] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.279129] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: e08c0362-c640-4658-b7bb-a4309abee8c6 is going to be created. [ 693.304192] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.304192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.304192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.304192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.304192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.304192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.358282] env[69728]: INFO networking_nsxv3.common.synchronization [None req-876f5c07-3713-4a35-b2c6-ea1fb448ea26 None None] Enqueued Resource ID: f3ff3c39-fc6d-4b07-b028-846044750419 with Priority: HIGHEST for action port [ 693.358947] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ff3c39-fc6d-4b07-b028-846044750419 with Priority: HIGHEST for action port [ 693.359236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ff3c39-fc6d-4b07-b028-846044750419 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.359331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ff3c39-fc6d-4b07-b028-846044750419" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.359523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ff3c39-fc6d-4b07-b028-846044750419" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.359621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ff3c39-fc6d-4b07-b028-846044750419" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.360169] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ff3c39-fc6d-4b07-b028-846044750419',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.537394] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbdab810-8531-436e-b866-5ec607f62611 [ 693.537394] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.537394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.537394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.537394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.537394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.537394] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbdab810-8531-436e-b866-5ec607f62611 already deleted. [ 693.537394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbdab810-8531-436e-b866-5ec607f62611" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.651243] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.651802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.651802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.651909] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.651995] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.652162] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 179b35b3-b3fd-4ac1-95d3-b28fd07f45cf not found, creating... [ 693.652453] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.652583] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.652703] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.652925] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.653070] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.653356] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.653964] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.653964] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.653964] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.653964] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.654951] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 179b35b3-b3fd-4ac1-95d3-b28fd07f45cf is going to be created. [ 693.676614] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.677173] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.677468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.679057] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.679057] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.679057] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.864482] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3ff3c39-fc6d-4b07-b028-846044750419 [ 693.864482] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.864482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.864482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.864482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.864482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.864843] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3ff3c39-fc6d-4b07-b028-846044750419 already deleted. [ 693.864843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ff3c39-fc6d-4b07-b028-846044750419" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.009263] env[69728]: INFO networking_nsxv3.common.synchronization [req-967dce6e-dbeb-4cda-a61e-3b806dfe43ad req-2200ce97-eb7c-41f4-bc9b-d9e19826948a tempest-FloatingIPsAssociationNegativeTestJSON-1275738109 tempest-FloatingIPsAssociationNegativeTestJSON-1275738109-project-member] Enqueued Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_members [ 694.009263] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_members [ 694.011396] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.011396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.011396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.011396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.011624] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.011674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.011706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.011871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.011988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.012087] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.268808] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b98c4f8d-80ee-4642-b743-a1fa25074101 None None] Enqueued Resource ID: 71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3 with Priority: HIGHEST for action port [ 694.269088] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3 with Priority: HIGHEST for action port [ 694.269668] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.269778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.269845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.270832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.270919] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.517016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.517016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.517016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.517016] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e already deleted. [ 694.517637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.700558] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c07c53b9-b92a-425d-8250-b7f598ffd660 in Status: SUCCESS [ 694.700785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.701056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.701376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.701605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.701848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.702024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.702201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.703886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.703886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.703886] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.749117] env[69728]: INFO networking_nsxv3.common.synchronization [req-ba8ba5d9-f3f0-4904-aa48-a9a5461c3134 req-dad05f9b-fd77-41b7-a6b7-7f0b212cfbbf service nova] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 694.749497] env[69728]: INFO networking_nsxv3.common.synchronization [req-ba8ba5d9-f3f0-4904-aa48-a9a5461c3134 req-dad05f9b-fd77-41b7-a6b7-7f0b212cfbbf service nova] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 694.749728] env[69728]: INFO networking_nsxv3.common.synchronization [req-ba8ba5d9-f3f0-4904-aa48-a9a5461c3134 req-dad05f9b-fd77-41b7-a6b7-7f0b212cfbbf service nova] Enqueued Resource ID: e08c0362-c640-4658-b7bb-a4309abee8c6 with Priority: HIGHEST for action port [ 694.750234] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 694.750415] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 694.750480] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08c0362-c640-4658-b7bb-a4309abee8c6 with Priority: HIGHEST for action port [ 694.750835] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.750993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.751059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.751312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.751493] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.752218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.752338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.752536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.752591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.752727] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.752836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.752903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.753055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.753146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.753236] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.754048] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e08c0362-c640-4658-b7bb-a4309abee8c6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.754048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.754230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.754441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.754441] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e08c0362-c640-4658-b7bb-a4309abee8c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.777289] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3 [ 694.777289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.777289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.777289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.777289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.777289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.777289] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3 already deleted. [ 694.777289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71fcc7ef-6cd3-476e-ad7d-66e90b9e84d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.914691] env[69728]: INFO networking_nsxv3.common.synchronization [None req-aa54c1ac-9eb6-4696-ba9d-51549a731d84 None None] Enqueued Resource ID: f28487d1-9f0b-4c54-b63f-caa54d160c67 with Priority: HIGHEST for action port [ 694.915655] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28487d1-9f0b-4c54-b63f-caa54d160c67 with Priority: HIGHEST for action port [ 694.916627] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f28487d1-9f0b-4c54-b63f-caa54d160c67 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.916779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f28487d1-9f0b-4c54-b63f-caa54d160c67" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.916850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f28487d1-9f0b-4c54-b63f-caa54d160c67" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.917171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f28487d1-9f0b-4c54-b63f-caa54d160c67" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.917261] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28487d1-9f0b-4c54-b63f-caa54d160c67',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.053403] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-716 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.053695] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-716" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.053860] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-716" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.054266] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-716" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.054539] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.054775] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.054938] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.055268] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.055414] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.055698] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.056212] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.056277] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.056409] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.056555] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 695.056693] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.056859] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.079544] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.079544] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 695.079544] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.079544] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-716" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.079954] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-4a2d137e-a221-4bfb-81ef-0c9927d13de7 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.080459] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.080459] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.080786] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.081214] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2d137e-a221-4bfb-81ef-0c9927d13de7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.205536] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.205768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.205810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.206137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.206222] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.206397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.206397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.206576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.206687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.206785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.206932] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.207035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.207099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.207246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.207404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.207648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.207648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.207732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.207827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.207918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.208031] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.257199] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.257199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.257199] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.257889] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e08c0362-c640-4658-b7bb-a4309abee8c6 with status ACTIVE [ 695.257889] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.257889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.257889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.258043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.258076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.258249] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.258336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.258418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.258597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.258661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.258821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.258909] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.258966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.259141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.259212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.259293] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e08c0362-c640-4658-b7bb-a4309abee8c6 is going to be updated. [ 695.281984] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.281984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.281984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.281984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.281984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.281984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.419257] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f28487d1-9f0b-4c54-b63f-caa54d160c67 [ 695.419649] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.419757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.419840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.420087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.420151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.420240] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f28487d1-9f0b-4c54-b63f-caa54d160c67 already deleted. [ 695.420332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f28487d1-9f0b-4c54-b63f-caa54d160c67" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.583605] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.583984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.584093] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.584377] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.586016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.586016] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 4a2d137e-a221-4bfb-81ef-0c9927d13de7 not found, creating... [ 695.586016] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.586016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.586016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.586016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.586016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.586413] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.586623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.586753] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.586972] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.587154] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.587380] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 4a2d137e-a221-4bfb-81ef-0c9927d13de7 is going to be created. [ 695.609567] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.609818] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.609944] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.610282] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.610445] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.613021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.714320] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c07c53b9-b92a-425d-8250-b7f598ffd660: rpc.has_security_group_logging(os_id): False [ 695.731856] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.734042] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.734042] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.734042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.734957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.735215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.735383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.737342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.737342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.737342] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c07c53b9-b92a-425d-8250-b7f598ffd660 is going to be created. [ 695.761894] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.795997] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.796151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.796256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.796433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.796604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.808818] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c07c53b9-b92a-425d-8250-b7f598ffd660 in Status: IN_PROGRESS for 2s [ 696.265461] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.266792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.266792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.266792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.266792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.266792] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be created. [ 696.292384] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.292546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.292596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.293543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.294433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.307744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: UNINITIALIZED for 2s [ 696.528126] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7a22c278-2977-4e82-b4de-8e76b91a8056 None None] Enqueued Resource ID: 79888101-aeeb-42fc-a38d-30f9c7b069ef with Priority: HIGHEST for action port [ 696.528756] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79888101-aeeb-42fc-a38d-30f9c7b069ef with Priority: HIGHEST for action port [ 696.529109] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-79888101-aeeb-42fc-a38d-30f9c7b069ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.529332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79888101-aeeb-42fc-a38d-30f9c7b069ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.529381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79888101-aeeb-42fc-a38d-30f9c7b069ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.529634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79888101-aeeb-42fc-a38d-30f9c7b069ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.529722] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79888101-aeeb-42fc-a38d-30f9c7b069ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.632689] env[69728]: INFO networking_nsxv3.common.synchronization [req-a12f2ac6-713b-4e26-b6b4-bb62b1b4bade req-083adb15-d439-4666-941a-a46e9345e293 service nova] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_rules [ 696.632689] env[69728]: INFO networking_nsxv3.common.synchronization [req-a12f2ac6-713b-4e26-b6b4-bb62b1b4bade req-083adb15-d439-4666-941a-a46e9345e293 service nova] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 696.632689] env[69728]: INFO networking_nsxv3.common.synchronization [req-a12f2ac6-713b-4e26-b6b4-bb62b1b4bade req-083adb15-d439-4666-941a-a46e9345e293 service nova] Enqueued Resource ID: 179b35b3-b3fd-4ac1-95d3-b28fd07f45cf with Priority: HIGHEST for action port [ 696.633232] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_rules [ 696.633469] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 696.634442] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179b35b3-b3fd-4ac1-95d3-b28fd07f45cf with Priority: HIGHEST for action port [ 696.634442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.634442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.634634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.634781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.634897] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.636038] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.636418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.636530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.636728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.637689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.637689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.637689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.637689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.637689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.637689] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.638382] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.638382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.638382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.638495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.638940] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('179b35b3-b3fd-4ac1-95d3-b28fd07f45cf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.760941] env[69728]: INFO networking_nsxv3.common.synchronization [None req-21b94093-db09-4dfd-aa8c-82ffef326c77 None None] Enqueued Resource ID: 204a3b87-ab03-47be-8d8f-714e9c82625a with Priority: HIGHEST for action port [ 696.761599] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 204a3b87-ab03-47be-8d8f-714e9c82625a with Priority: HIGHEST for action port [ 696.761884] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-204a3b87-ab03-47be-8d8f-714e9c82625a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.762048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-204a3b87-ab03-47be-8d8f-714e9c82625a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.762123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-204a3b87-ab03-47be-8d8f-714e9c82625a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.762376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-204a3b87-ab03-47be-8d8f-714e9c82625a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.762456] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('204a3b87-ab03-47be-8d8f-714e9c82625a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.037369] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79888101-aeeb-42fc-a38d-30f9c7b069ef [ 697.037369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.037369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.037369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.037369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.037369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.037633] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79888101-aeeb-42fc-a38d-30f9c7b069ef already deleted. [ 697.037633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79888101-aeeb-42fc-a38d-30f9c7b069ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.140734] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.140868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.141125] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.141921] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 179b35b3-b3fd-4ac1-95d3-b28fd07f45cf with status ACTIVE [ 697.142567] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.142567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.142567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.142567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.142567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.142859] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.142859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.142941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.143247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.143247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.143414] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.143414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.143501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.144249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.144249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.144249] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 179b35b3-b3fd-4ac1-95d3-b28fd07f45cf is going to be updated. [ 697.150585] env[69728]: INFO networking_nsxv3.common.synchronization [req-a78487a7-b90a-4a0c-9d4a-84260f640a8c req-b7d7e0a6-870b-431a-af66-f1c7e311d6e2 tempest-ServerDiagnosticsNegativeTest-627869311 tempest-ServerDiagnosticsNegativeTest-627869311-project-member] Enqueued Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_members [ 697.151762] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_members [ 697.151762] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.151762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.151762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.152389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.152389] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.152389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.152389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.153537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.153537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.153537] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.164366] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.165749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.165749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.165749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.165749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.165749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-179b35b3-b3fd-4ac1-95d3-b28fd07f45cf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.207035] env[69728]: INFO networking_nsxv3.common.synchronization [req-967dce6e-dbeb-4cda-a61e-3b806dfe43ad req-a8a92127-3926-46b6-aff7-ee89958b87aa service nova] Enqueued Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_rules [ 697.207220] env[69728]: INFO networking_nsxv3.common.synchronization [req-967dce6e-dbeb-4cda-a61e-3b806dfe43ad req-a8a92127-3926-46b6-aff7-ee89958b87aa service nova] Enqueued Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_members [ 697.207362] env[69728]: INFO networking_nsxv3.common.synchronization [req-967dce6e-dbeb-4cda-a61e-3b806dfe43ad req-a8a92127-3926-46b6-aff7-ee89958b87aa service nova] Enqueued Resource ID: 4a2d137e-a221-4bfb-81ef-0c9927d13de7 with Priority: HIGHEST for action port [ 697.207613] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_rules [ 697.207745] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_members [ 697.207844] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2d137e-a221-4bfb-81ef-0c9927d13de7 with Priority: HIGHEST for action port [ 697.208392] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.208527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.208609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.208859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.208940] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.211327] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.211327] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.211327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.211327] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.212146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2d137e-a221-4bfb-81ef-0c9927d13de7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.212146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.212146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.212146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.212281] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2d137e-a221-4bfb-81ef-0c9927d13de7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.264576] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 204a3b87-ab03-47be-8d8f-714e9c82625a [ 697.264890] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.264975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.265039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.265209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.265333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.265432] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:204a3b87-ab03-47be-8d8f-714e9c82625a already deleted. [ 697.265511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-204a3b87-ab03-47be-8d8f-714e9c82625a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.646137] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.657215] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.657215] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.657215] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 already deleted. [ 697.657215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.719735] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.723576] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.723776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.725472] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2d137e-a221-4bfb-81ef-0c9927d13de7 with status ACTIVE [ 697.725721] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.725914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.726124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.726386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.726482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.726663] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.726777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.726809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.726980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.727065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.727252] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.727342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.727405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.729385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.729385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.729385] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2d137e-a221-4bfb-81ef-0c9927d13de7 is going to be updated. [ 697.750313] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.750313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.750313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.750313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.750313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.750313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2d137e-a221-4bfb-81ef-0c9927d13de7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.828214] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c07c53b9-b92a-425d-8250-b7f598ffd660 in Status: SUCCESS [ 697.828214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.975673] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e668d717-a00d-4dd7-920a-dbbed5b906be None None] Enqueued Resource ID: d1e4d0de-1b4b-4d34-b827-cba93cd76a72 with Priority: HIGHEST for action port [ 697.975673] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e4d0de-1b4b-4d34-b827-cba93cd76a72 with Priority: HIGHEST for action port [ 697.975673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e4d0de-1b4b-4d34-b827-cba93cd76a72 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.975673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e4d0de-1b4b-4d34-b827-cba93cd76a72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.975673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e4d0de-1b4b-4d34-b827-cba93cd76a72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.975673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e4d0de-1b4b-4d34-b827-cba93cd76a72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.976760] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e4d0de-1b4b-4d34-b827-cba93cd76a72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.150592] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.150592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.150592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.150765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.155540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.155540] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be created. [ 698.179293] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.180018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.180018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.180018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.180018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.190146] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: UNINITIALIZED for 2s [ 698.208338] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.208338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.208338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.208338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.208535] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.208535] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.208697] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.210258] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.210258] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.210258] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.210258] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.210258] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.210258] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.210258] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.210258] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.210258] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.230466] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.241480] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.241480] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.241603] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.241780] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.242109] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-594871e0-29b5-4f96-9400-c0c3586bd63b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.242275] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.242393] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.242783] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.242917] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('594871e0-29b5-4f96-9400-c0c3586bd63b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.320367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.320367] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.320367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.320367] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.465741] env[69728]: INFO networking_nsxv3.common.synchronization [None req-f946e14c-01e7-4039-895e-06f0004598b8 None None] Enqueued Resource ID: ab877b2f-062a-47d7-9a6c-511f01b1fd0c with Priority: HIGHEST for action port [ 698.465741] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab877b2f-062a-47d7-9a6c-511f01b1fd0c with Priority: HIGHEST for action port [ 698.465741] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab877b2f-062a-47d7-9a6c-511f01b1fd0c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.465741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab877b2f-062a-47d7-9a6c-511f01b1fd0c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.465741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab877b2f-062a-47d7-9a6c-511f01b1fd0c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.465741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab877b2f-062a-47d7-9a6c-511f01b1fd0c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.465741] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab877b2f-062a-47d7-9a6c-511f01b1fd0c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.480360] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1e4d0de-1b4b-4d34-b827-cba93cd76a72 [ 698.480428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.480511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.480583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.480800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.480903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.480980] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1e4d0de-1b4b-4d34-b827-cba93cd76a72 already deleted. [ 698.481080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e4d0de-1b4b-4d34-b827-cba93cd76a72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.732883] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.733104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.733145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.733362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.733506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.733620] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e is going to be created. [ 698.748570] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.749458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.749458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.749458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.749458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.749692] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 594871e0-29b5-4f96-9400-c0c3586bd63b not found, creating... [ 698.751059] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.751059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.751059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.751059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.751059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.751059] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.751415] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.751415] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.751610] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.751808] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.752022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 594871e0-29b5-4f96-9400-c0c3586bd63b is going to be created. [ 698.757924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.758498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.758498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.758888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.759177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.769297] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e in Status: UNINITIALIZED for 2s [ 698.775229] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.775672] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.775672] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.775867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.776128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.776385] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.826667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.826847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.826882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.827130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.827340] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.827437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.827561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.827691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.827796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.827901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.828065] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.828172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.828271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.829240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.829240] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.829240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.829240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.829240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.829240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.829240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.829240] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.969257] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab877b2f-062a-47d7-9a6c-511f01b1fd0c [ 698.970520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.970520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.970520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.970520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.970520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.970775] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab877b2f-062a-47d7-9a6c-511f01b1fd0c already deleted. [ 698.970862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab877b2f-062a-47d7-9a6c-511f01b1fd0c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.171246] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e74aecc7-371b-4dcf-93ed-d32347154419 None None] Enqueued Resource ID: 0d378b7a-055f-444c-bd77-a4f332a9d766 with Priority: HIGHEST for action port [ 699.171562] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d378b7a-055f-444c-bd77-a4f332a9d766 with Priority: HIGHEST for action port [ 699.171988] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d378b7a-055f-444c-bd77-a4f332a9d766 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.172142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d378b7a-055f-444c-bd77-a4f332a9d766" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.172188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d378b7a-055f-444c-bd77-a4f332a9d766" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.172435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d378b7a-055f-444c-bd77-a4f332a9d766" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.172517] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d378b7a-055f-444c-bd77-a4f332a9d766',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.334955] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e3be409-32bc-4a01-bfa9-d2153d5679f3: rpc.has_security_group_logging(os_id): False [ 699.355983] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.356167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.356253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.356508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.356616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.356843] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.356935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.356995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.357166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.357261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.357417] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.357499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.357584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.357744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.357819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.358964] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.359123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.359203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.359379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.359459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.359573] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be created. [ 699.413521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.413670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.413747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.413967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.414163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.424769] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 699.477943] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e5dba82c-dd25-44e8-8c7b-f58a01997af8 None None] Enqueued Resource ID: 3cbc6f5f-e219-4295-a775-fda5ca16e0c7 with Priority: HIGHEST for action port [ 699.478506] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cbc6f5f-e219-4295-a775-fda5ca16e0c7 with Priority: HIGHEST for action port [ 699.478862] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cbc6f5f-e219-4295-a775-fda5ca16e0c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.482079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cbc6f5f-e219-4295-a775-fda5ca16e0c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.482173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cbc6f5f-e219-4295-a775-fda5ca16e0c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.482447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cbc6f5f-e219-4295-a775-fda5ca16e0c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.482542] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cbc6f5f-e219-4295-a775-fda5ca16e0c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.675111] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d378b7a-055f-444c-bd77-a4f332a9d766 [ 699.675376] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.675511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.675598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.675943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.675943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.676028] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d378b7a-055f-444c-bd77-a4f332a9d766 already deleted. [ 699.676089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d378b7a-055f-444c-bd77-a4f332a9d766" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.910637] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc6c290c-0094-4cf9-9118-551657e91bf1 req-d7580d26-1e47-4257-9eb1-784a374ac4c7 tempest-ServersAdminNegativeTestJSON-1903866848 tempest-ServersAdminNegativeTestJSON-1903866848-project-member] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 699.911589] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 699.911589] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.911589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.911770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.911846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.911999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.915832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.915961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.918768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.918768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.918768] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.986326] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cbc6f5f-e219-4295-a775-fda5ca16e0c7 [ 699.986553] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.986692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.986766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.987203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.987292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.987389] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cbc6f5f-e219-4295-a775-fda5ca16e0c7 already deleted. [ 699.987468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cbc6f5f-e219-4295-a775-fda5ca16e0c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.111093] env[69728]: INFO networking_nsxv3.common.synchronization [None req-cc06fc19-0969-43c2-9b2e-3d4c0e67944d None None] Enqueued Resource ID: 02b05401-fc94-416d-ad93-00155d981229 with Priority: HIGHEST for action port [ 700.113565] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b05401-fc94-416d-ad93-00155d981229 with Priority: HIGHEST for action port [ 700.113949] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-02b05401-fc94-416d-ad93-00155d981229 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.114111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02b05401-fc94-416d-ad93-00155d981229" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.114158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02b05401-fc94-416d-ad93-00155d981229" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.114422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02b05401-fc94-416d-ad93-00155d981229" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.114507] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02b05401-fc94-416d-ad93-00155d981229',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.190827] env[69728]: INFO networking_nsxv3.common.synchronization [None req-52a7d014-bddb-4977-b464-65a6702be982 None None] Enqueued Resource ID: b40d9cb8-6d8c-4f91-abf4-1fd36269e03c with Priority: HIGHEST for action port [ 700.193115] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40d9cb8-6d8c-4f91-abf4-1fd36269e03c with Priority: HIGHEST for action port [ 700.193987] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40d9cb8-6d8c-4f91-abf4-1fd36269e03c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.196220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40d9cb8-6d8c-4f91-abf4-1fd36269e03c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.196421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40d9cb8-6d8c-4f91-abf4-1fd36269e03c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.197095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40d9cb8-6d8c-4f91-abf4-1fd36269e03c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.197267] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40d9cb8-6d8c-4f91-abf4-1fd36269e03c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.216448] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 700.216864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.217086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.218018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.218018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.218018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.218018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.218018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.218301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.218301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.218301] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.419386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.419462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.419462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.420106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.420106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.420106] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.420106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.420106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.420320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.420320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.420380] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 already deleted. [ 700.420486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.529197] env[69728]: INFO networking_nsxv3.common.synchronization [req-a78487a7-b90a-4a0c-9d4a-84260f640a8c req-ac08e0e4-6b0f-42e8-a82e-6f83e0bc0f4b service nova] Enqueued Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_rules [ 700.529334] env[69728]: INFO networking_nsxv3.common.synchronization [req-a78487a7-b90a-4a0c-9d4a-84260f640a8c req-ac08e0e4-6b0f-42e8-a82e-6f83e0bc0f4b service nova] Enqueued Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_members [ 700.529467] env[69728]: INFO networking_nsxv3.common.synchronization [req-a78487a7-b90a-4a0c-9d4a-84260f640a8c req-ac08e0e4-6b0f-42e8-a82e-6f83e0bc0f4b service nova] Enqueued Resource ID: 594871e0-29b5-4f96-9400-c0c3586bd63b with Priority: HIGHEST for action port [ 700.529687] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_rules [ 700.529811] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_members [ 700.529904] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 594871e0-29b5-4f96-9400-c0c3586bd63b with Priority: HIGHEST for action port [ 700.531376] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.533572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.533572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.533572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.533572] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.533572] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.533572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.533572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.534175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.534573] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.534721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.534793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.534973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.535080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.535170] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.535930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-594871e0-29b5-4f96-9400-c0c3586bd63b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.536092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.536207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.536397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.536496] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('594871e0-29b5-4f96-9400-c0c3586bd63b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.617083] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02b05401-fc94-416d-ad93-00155d981229 [ 700.617279] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.617435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.617487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.617790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.617939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.618090] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02b05401-fc94-416d-ad93-00155d981229 already deleted. [ 700.618337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02b05401-fc94-416d-ad93-00155d981229" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.702820] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b40d9cb8-6d8c-4f91-abf4-1fd36269e03c [ 700.702820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.702820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.702820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.703289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.703444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.703753] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b40d9cb8-6d8c-4f91-abf4-1fd36269e03c already deleted. [ 700.703753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40d9cb8-6d8c-4f91-abf4-1fd36269e03c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.721074] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.721249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.721513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.721659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.721699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.721786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.721850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.721998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.722103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.722186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.722357] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.722421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.722484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.722628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.722767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.722886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.722943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.723175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.723175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.723273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.723315] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.779528] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e in Status: SUCCESS [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.779528] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.779528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.780188] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.039282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.039548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.039548] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.040756] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 594871e0-29b5-4f96-9400-c0c3586bd63b with status ACTIVE [ 701.040756] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.040915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.040915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.041078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.041661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.041661] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.041661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.041661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.041661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.041887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.041887] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.041967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.049754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.049754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.049754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.049754] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 594871e0-29b5-4f96-9400-c0c3586bd63b is going to be updated. [ 701.074940] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.074940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.074940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.076555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.076555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.076555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-594871e0-29b5-4f96-9400-c0c3586bd63b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.227353] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 954e79e4-ed41-40fb-8699-8b26721b1d77: rpc.has_security_group_logging(os_id): False [ 701.251252] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.251252] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.251252] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.251252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.251791] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.251791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.251791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.251791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.251791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.252125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be created. [ 701.284085] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.284187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.284265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.284513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.284691] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.284848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.284890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.285064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.285158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.285248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.285946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.285946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.285946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.285946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.285946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.286174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.286174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.286234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.286263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.286359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.286438] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.312908] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.313072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.313175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.313391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.313578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.325904] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: IN_PROGRESS for 2s [ 701.398891] env[69728]: INFO networking_nsxv3.common.synchronization [None req-bc34fde1-de78-4675-bb0e-4ed8f29a6e51 None None] Enqueued Resource ID: c1d71715-de93-4caa-be0b-76561330afe1 with Priority: HIGHEST for action port [ 701.399180] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1d71715-de93-4caa-be0b-76561330afe1 with Priority: HIGHEST for action port [ 701.399834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1d71715-de93-4caa-be0b-76561330afe1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.399980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1d71715-de93-4caa-be0b-76561330afe1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.399980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1d71715-de93-4caa-be0b-76561330afe1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.400200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1d71715-de93-4caa-be0b-76561330afe1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.400288] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1d71715-de93-4caa-be0b-76561330afe1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.442325] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 701.442325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.542182] env[69728]: INFO networking_nsxv3.common.synchronization [None req-883e404b-95f7-471b-be39-7a3f7e060c22 None None] Enqueued Resource ID: 94030116-3108-4ea2-a450-48d10175f96f with Priority: HIGHEST for action port [ 701.542182] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94030116-3108-4ea2-a450-48d10175f96f with Priority: HIGHEST for action port [ 701.542182] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-94030116-3108-4ea2-a450-48d10175f96f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.545057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94030116-3108-4ea2-a450-48d10175f96f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.545862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94030116-3108-4ea2-a450-48d10175f96f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.545862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94030116-3108-4ea2-a450-48d10175f96f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.545862] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94030116-3108-4ea2-a450-48d10175f96f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.552477] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.792158] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c94ae4c-4f3f-4a89-b0b0-b5519974878e: rpc.has_security_group_logging(os_id): False [ 701.809630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.809782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.809851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.810439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.810439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.810629] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.810779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.810849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.811023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.811106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.811294] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.811391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.811454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.811795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.811876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.812084] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.812178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.812238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.812380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.812450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.812532] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e is going to be created. [ 701.830115] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.830317] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.830915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.830915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.831293] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.835043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.835043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.835043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.835043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.835043] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.835043] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.835043] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.835043] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.835043] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 701.835043] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.835043] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.851576] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.851753] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 701.851893] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.852142] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.852402] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c660b595-31e1-49d2-b5f5-075369f221c1 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.852573] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.852696] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.853032] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.853176] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c660b595-31e1-49d2-b5f5-075369f221c1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.874045] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.874045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.874276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.874552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.874744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.885991] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e in Status: IN_PROGRESS for 2s [ 701.902344] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c1d71715-de93-4caa-be0b-76561330afe1 [ 701.902573] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.902703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.902773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.902972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.903091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.903186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c1d71715-de93-4caa-be0b-76561330afe1 already deleted. [ 701.903354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1d71715-de93-4caa-be0b-76561330afe1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.047951] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94030116-3108-4ea2-a450-48d10175f96f [ 702.048230] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.048345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.048411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.051014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.051014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.051014] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94030116-3108-4ea2-a450-48d10175f96f already deleted. [ 702.051014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94030116-3108-4ea2-a450-48d10175f96f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.055460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.055604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.055683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.055953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.056229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.056367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 is going to be created. [ 702.080921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.082532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.082532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.082532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.082532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.094667] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 in Status: UNINITIALIZED for 2s [ 702.359194] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.359194] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c660b595-31e1-49d2-b5f5-075369f221c1 not found, creating... [ 702.359194] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.359194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.360176] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.360176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.360176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.360176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.360176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.360878] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c660b595-31e1-49d2-b5f5-075369f221c1 is going to be created. [ 702.380728] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.380858] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.380953] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.381290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.381519] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.381742] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.309740] env[69728]: INFO networking_nsxv3.common.synchronization [req-da8b52e9-db5b-419a-b56f-2031608c0698 req-7511cb03-26a4-4f8f-afa3-06da8efb5112 tempest-DeleteServersAdminTestJSON-38634096 tempest-DeleteServersAdminTestJSON-38634096-project-admin] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 703.310096] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 703.310656] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.310750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.310803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.311016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.311315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.311421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.311486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.311670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.311757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.311847] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.339467] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 703.339738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.588143] env[69728]: INFO networking_nsxv3.common.synchronization [None req-98a069f9-c5f0-4269-8e94-74c17625171e tempest-ServersTestManualDisk-1834955542 tempest-ServersTestManualDisk-1834955542-project-member] Enqueued Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_rules [ 703.588143] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_rules [ 703.589488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.589985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.590185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.590556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.590777] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.817965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.817965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.817965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.817965] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be updated. [ 703.846177] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.846177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.846177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.846177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.846691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.855939] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: IN_PROGRESS for 2s [ 703.899209] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e in Status: SUCCESS [ 703.899209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.902130] env[69728]: INFO networking_nsxv3.common.synchronization [None req-56ef1292-a46a-4087-93f9-b566316cf257 tempest-ServersTestManualDisk-1834955542 tempest-ServersTestManualDisk-1834955542-project-member] Enqueued Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_rules [ 703.903120] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_rules [ 703.904094] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.904328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.106385] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 in Status: SUCCESS [ 704.106878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.107829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.107935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.108484] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.108484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.108484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.108484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.108878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.108878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.108878] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.115142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.115142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.115142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.115142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.115142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.115142] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 already deleted. [ 704.115142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.115142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.115760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.115760] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.292964] env[69728]: INFO networking_nsxv3.common.synchronization [None req-86af8e4f-76e8-4a90-8629-233b41b3d304 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 704.292964] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 704.293928] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.294399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.295433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.295433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.295832] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.434847] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc6c290c-0094-4cf9-9118-551657e91bf1 req-8101bae5-8f79-44b2-9d95-5bebc4e1725f service nova] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_rules [ 704.435131] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc6c290c-0094-4cf9-9118-551657e91bf1 req-8101bae5-8f79-44b2-9d95-5bebc4e1725f service nova] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 704.435177] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc6c290c-0094-4cf9-9118-551657e91bf1 req-8101bae5-8f79-44b2-9d95-5bebc4e1725f service nova] Enqueued Resource ID: c660b595-31e1-49d2-b5f5-075369f221c1 with Priority: HIGHEST for action port [ 704.436749] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_rules [ 704.439388] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 704.440358] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c660b595-31e1-49d2-b5f5-075369f221c1 with Priority: HIGHEST for action port [ 704.441480] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.442440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.442440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.442440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.442440] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.443336] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.443457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.443521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.443721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.443883] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.443979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.444966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.445175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.445266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.445374] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.446338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c660b595-31e1-49d2-b5f5-075369f221c1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.446461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.446517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.446688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.446767] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c660b595-31e1-49d2-b5f5-075369f221c1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.490936] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e3d8df13-4876-4a12-9461-d428c6fb4ce8 None None] Enqueued Resource ID: 26d39433-b6a0-422c-b7ef-707cd604c69e with Priority: HIGHEST for action port [ 704.491820] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d39433-b6a0-422c-b7ef-707cd604c69e with Priority: HIGHEST for action port [ 704.492156] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d39433-b6a0-422c-b7ef-707cd604c69e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.492285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d39433-b6a0-422c-b7ef-707cd604c69e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.492340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d39433-b6a0-422c-b7ef-707cd604c69e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.492606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d39433-b6a0-422c-b7ef-707cd604c69e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.492686] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d39433-b6a0-422c-b7ef-707cd604c69e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.612986] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.612986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.612986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.612986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.612986] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.613320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.613320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.613320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.613407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.613455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.614218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.614218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.614218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.614218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.614218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.614218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.614218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.614705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.614705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.614705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.614705] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.634112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.634367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.634460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.634691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.634787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.635169] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 already deleted. [ 704.635169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.837961] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.837961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.837961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.837961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.837961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.837961] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef already deleted. [ 704.837961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.948239] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.949510] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.949643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.954099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c660b595-31e1-49d2-b5f5-075369f221c1 with status ACTIVE [ 704.954218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.955250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.955250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.955501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.955625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.956386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.956548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.956619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.956852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.957256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.958267] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.961385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.961385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.961385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.961385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.961385] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c660b595-31e1-49d2-b5f5-075369f221c1 is going to be updated. [ 704.979813] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.980012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.980200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.981260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.981260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.981260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c660b595-31e1-49d2-b5f5-075369f221c1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.995948] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26d39433-b6a0-422c-b7ef-707cd604c69e [ 704.997170] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.997170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.997170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.997170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.997170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.997170] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26d39433-b6a0-422c-b7ef-707cd604c69e already deleted. [ 704.997170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d39433-b6a0-422c-b7ef-707cd604c69e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.067399] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9f70a893-2336-4358-8b0f-52a42895e363 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 705.068480] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 705.070927] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.071119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.071338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.071847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.072817] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.119549] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1bbb88c-d56a-4e1c-b39c-5f69921fcc29: rpc.has_security_group_logging(os_id): False [ 705.154023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.154225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.154301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.154538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.154627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.154859] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.154955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.155028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.155579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.155579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.155579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.155579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.155579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.155809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.155809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.155972] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.156554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.156554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.156866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.157507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.157507] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 is going to be created. [ 705.214490] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9bc06ac6-94e0-40da-8588-cd9bafd3f574 tempest-ServersTestFqdnHostnames-1351333799 tempest-ServersTestFqdnHostnames-1351333799-project-member] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_rules [ 705.215549] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_rules [ 705.216572] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.216572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.216572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.216720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.216720] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.223167] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.223350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.224166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.224166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.224166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.237328] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 in Status: IN_PROGRESS for 2s [ 705.450928] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.575750] env[69728]: INFO networking_nsxv3.common.synchronization [None req-c9b05631-1bf1-4f25-b379-ef48bd9bd5ea tempest-ServersTestFqdnHostnames-1351333799 tempest-ServersTestFqdnHostnames-1351333799-project-member] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_rules [ 705.575750] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_rules [ 705.575750] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.575750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.601713] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.601713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.601713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.601713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.601713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.601713] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef already deleted. [ 705.601713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.735505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.735677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.735741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.735957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.736063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.736180] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 already deleted. [ 705.736269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.736418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.736574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.736671] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.865014] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 705.865207] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f deletion is rescheduled due to dependency. [ 705.865318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.953797] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.953956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.954051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.954346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.954463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.954611] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be created. [ 705.975478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.975692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.975803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.975973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.976148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.986635] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: UNINITIALIZED for 2s [ 706.257917] env[69728]: INFO networking_nsxv3.common.synchronization [None req-00844a2b-dada-479a-aafb-257765550c18 None None] Enqueued Resource ID: b3747d50-5bf5-4708-9d84-41da6f8326ad with Priority: HIGHEST for action port [ 706.259732] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3747d50-5bf5-4708-9d84-41da6f8326ad with Priority: HIGHEST for action port [ 706.260309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3747d50-5bf5-4708-9d84-41da6f8326ad taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.260309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3747d50-5bf5-4708-9d84-41da6f8326ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.260309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3747d50-5bf5-4708-9d84-41da6f8326ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.260605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3747d50-5bf5-4708-9d84-41da6f8326ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.260683] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3747d50-5bf5-4708-9d84-41da6f8326ad',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.281982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.281982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.281982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.281982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.281982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.281982] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 already deleted. [ 706.281982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.541194] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6f1d97e8-05b5-4bcd-a587-092efaf966b9 None None] Enqueued Resource ID: ff1f6ba4-2ff8-4268-9ea3-a0056dd01701 with Priority: HIGHEST for action port [ 706.542644] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff1f6ba4-2ff8-4268-9ea3-a0056dd01701 with Priority: HIGHEST for action port [ 706.542644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff1f6ba4-2ff8-4268-9ea3-a0056dd01701 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.542644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff1f6ba4-2ff8-4268-9ea3-a0056dd01701" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.542644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff1f6ba4-2ff8-4268-9ea3-a0056dd01701" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.542644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff1f6ba4-2ff8-4268-9ea3-a0056dd01701" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.542644] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff1f6ba4-2ff8-4268-9ea3-a0056dd01701',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.766866] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3747d50-5bf5-4708-9d84-41da6f8326ad [ 706.767125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.767263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.767329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.767544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.767651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.767758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3747d50-5bf5-4708-9d84-41da6f8326ad already deleted. [ 706.767842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3747d50-5bf5-4708-9d84-41da6f8326ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.046676] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff1f6ba4-2ff8-4268-9ea3-a0056dd01701 [ 707.046910] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.047068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.047136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.047354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.047426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.047514] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff1f6ba4-2ff8-4268-9ea3-a0056dd01701 already deleted. [ 707.047592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff1f6ba4-2ff8-4268-9ea3-a0056dd01701" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.249076] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 in Status: SUCCESS [ 707.249076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.759195] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3db50b1-0082-48df-8e13-eb5bc4d76b18 req-0c0dd376-4b05-468d-9add-a983f0aa6db3 tempest-TenantUsagesTestJSON-324771647 tempest-TenantUsagesTestJSON-324771647-project-member] Enqueued Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_members [ 707.759195] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_members [ 707.759195] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.759195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.759195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.759195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.759195] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.759195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.759195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.759795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.759795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.759795] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.999508] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 707.999803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.000354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.000547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.001444] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.001576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.001644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.001835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.002061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.002061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.002322] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.262398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.262614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.262678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.262901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.263016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.263234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.263336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.263401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.263561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.263664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.263713] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 242249ee-0650-4468-83db-52fb528ae0d1 already deleted. [ 708.263794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.506754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.506754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.506754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.507245] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.507245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.507245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.507245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.507371] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.507371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.507445] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.507670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.507670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.507845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.507845] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.864298] env[69728]: INFO networking_nsxv3.common.synchronization [None req-ff387658-5ece-49a1-be6c-6eb4e6c5d19a None None] Enqueued Resource ID: 9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5 with Priority: HIGHEST for action port [ 708.864557] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5 with Priority: HIGHEST for action port [ 708.865265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.865433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.865505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.865820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.865942] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.011171] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca8a02e9-47d1-471b-858b-1d6a0bebf739: rpc.has_security_group_logging(os_id): False [ 709.031791] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.032071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.032258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.032489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.032632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.032958] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.033160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.033252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.033456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.033581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.033931] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.034192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.034299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.034811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.034811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.034811] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.034977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.035093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.035327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.035424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.035572] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be created. [ 709.105674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.105961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.106140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.106475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.106741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.119842] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: IN_PROGRESS for 2s [ 709.216537] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.219366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.219366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.219366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.219366] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.220297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.220297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.220297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.220297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.220297] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.220297] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.220722] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.220722] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.220722] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 709.220722] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.220949] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.244216] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.244426] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 709.244520] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.246122] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.246122] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c88d4f38-1603-42ee-adaa-ea1bc512961b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.246122] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.246122] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.246122] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.246122] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c88d4f38-1603-42ee-adaa-ea1bc512961b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.368339] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5 [ 709.368589] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.368727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.368802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.369463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.369463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.369463] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5 already deleted. [ 709.369463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc175ee-ecd3-42d3-9106-a5f7bcd4fca5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.749907] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.750525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.750525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.750711] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.750961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.751113] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c88d4f38-1603-42ee-adaa-ea1bc512961b not found, creating... [ 709.751326] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.751491] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.751652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.751892] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.752050] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.752353] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.752506] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.752621] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.752899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.752994] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.753600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c88d4f38-1603-42ee-adaa-ea1bc512961b is going to be created. [ 709.773194] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.773365] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.773433] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.774488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.774488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.774488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.154479] env[69728]: INFO networking_nsxv3.common.synchronization [req-a5bfee40-0d95-40cd-88cb-d4ff2c547908 req-a3f7f358-edc5-4ab8-ba19-96a51dd341f0 tempest-ServerExternalEventsTest-1550345325 tempest-ServerExternalEventsTest-1550345325-project-member] Enqueued Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_members [ 710.154908] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGHEST for action security_group_members [ 710.155241] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.155767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.155767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.155767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.155767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.155979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.155979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.156311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.156423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.156551] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.295749] env[69728]: INFO networking_nsxv3.common.synchronization [None req-594a408a-905e-467b-82d7-bfe9c76c36bf None None] Enqueued Resource ID: 101f2278-86e2-4ded-87e6-df1a7681c119 with Priority: HIGHEST for action port [ 710.296722] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 101f2278-86e2-4ded-87e6-df1a7681c119 with Priority: HIGHEST for action port [ 710.300642] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-101f2278-86e2-4ded-87e6-df1a7681c119 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.300852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-101f2278-86e2-4ded-87e6-df1a7681c119" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.300887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-101f2278-86e2-4ded-87e6-df1a7681c119" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.301311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-101f2278-86e2-4ded-87e6-df1a7681c119" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.301450] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('101f2278-86e2-4ded-87e6-df1a7681c119',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.659042] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.659253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.659315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.659535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.659627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.660612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.660776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.660864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.661403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.661403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.661403] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c07c53b9-b92a-425d-8250-b7f598ffd660 is going to be updated. [ 710.685834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.686011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.686085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.686301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.686455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.697023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c07c53b9-b92a-425d-8250-b7f598ffd660 in Status: IN_PROGRESS for 2s [ 710.804479] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 101f2278-86e2-4ded-87e6-df1a7681c119 [ 710.804780] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.805267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.805681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.806408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.806645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.806910] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:101f2278-86e2-4ded-87e6-df1a7681c119 already deleted. [ 710.807134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-101f2278-86e2-4ded-87e6-df1a7681c119" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.938454] env[69728]: INFO networking_nsxv3.common.synchronization [None req-38eeb140-1743-4503-b875-1a4e86162f07 None None] Enqueued Resource ID: 5f5db5e6-9d6a-45b9-b944-6516e7f81568 with Priority: HIGHEST for action port [ 710.939788] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f5db5e6-9d6a-45b9-b944-6516e7f81568 with Priority: HIGHEST for action port [ 710.940288] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f5db5e6-9d6a-45b9-b944-6516e7f81568 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.940653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f5db5e6-9d6a-45b9-b944-6516e7f81568" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.940932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f5db5e6-9d6a-45b9-b944-6516e7f81568" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.941363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f5db5e6-9d6a-45b9-b944-6516e7f81568" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.941531] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f5db5e6-9d6a-45b9-b944-6516e7f81568',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.972853] env[69728]: INFO networking_nsxv3.common.synchronization [None req-455571b3-83bd-48bf-8732-383f9cfc94fd None None] Enqueued Resource ID: 46a9f3fc-4b65-4762-8f36-3e821dfa5dc4 with Priority: HIGHEST for action port [ 710.973429] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46a9f3fc-4b65-4762-8f36-3e821dfa5dc4 with Priority: HIGHEST for action port [ 710.973998] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-46a9f3fc-4b65-4762-8f36-3e821dfa5dc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.974138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46a9f3fc-4b65-4762-8f36-3e821dfa5dc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.974352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46a9f3fc-4b65-4762-8f36-3e821dfa5dc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.978900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46a9f3fc-4b65-4762-8f36-3e821dfa5dc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.980051] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46a9f3fc-4b65-4762-8f36-3e821dfa5dc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.132861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 711.136123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.136123] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3db50b1-0082-48df-8e13-eb5bc4d76b18 req-59dba477-92e5-4f6c-ac59-d4077dbfb8dd service nova] Enqueued Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_rules [ 711.136123] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3db50b1-0082-48df-8e13-eb5bc4d76b18 req-59dba477-92e5-4f6c-ac59-d4077dbfb8dd service nova] Enqueued Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_members [ 711.136123] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3db50b1-0082-48df-8e13-eb5bc4d76b18 req-59dba477-92e5-4f6c-ac59-d4077dbfb8dd service nova] Enqueued Resource ID: c88d4f38-1603-42ee-adaa-ea1bc512961b with Priority: HIGHEST for action port [ 711.136123] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_rules [ 711.136700] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_members [ 711.137440] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c88d4f38-1603-42ee-adaa-ea1bc512961b with Priority: HIGHEST for action port [ 711.137896] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.138044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.138117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.138409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.138495] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.139554] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.139758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.139827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.140105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.141017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.141238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.141299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.141596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.141980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.142089] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.147075] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c88d4f38-1603-42ee-adaa-ea1bc512961b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.147294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.147489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.147850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.148164] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c88d4f38-1603-42ee-adaa-ea1bc512961b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.153052] env[69728]: INFO networking_nsxv3.common.synchronization [None req-0519ccd5-4ca7-4b90-a167-bae5d9f7bb6f tempest-VolumesAdminNegativeTest-8298396 tempest-VolumesAdminNegativeTest-8298396-project-member] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_rules [ 711.154533] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_rules [ 711.155412] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.155747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.155864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.156170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.156433] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.445111] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f5db5e6-9d6a-45b9-b944-6516e7f81568 [ 711.445111] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.445111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.445111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.445323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.445413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.445474] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f5db5e6-9d6a-45b9-b944-6516e7f81568 already deleted. [ 711.445551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f5db5e6-9d6a-45b9-b944-6516e7f81568" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.482160] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46a9f3fc-4b65-4762-8f36-3e821dfa5dc4 [ 711.482445] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.482604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.482699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.482984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.483116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.483239] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46a9f3fc-4b65-4762-8f36-3e821dfa5dc4 already deleted. [ 711.483349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46a9f3fc-4b65-4762-8f36-3e821dfa5dc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.632415] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a60c5a6a-72cb-4d55-adbf-fb4c3f30e40e tempest-VolumesAdminNegativeTest-8298396 tempest-VolumesAdminNegativeTest-8298396-project-member] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_rules [ 711.632415] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_rules [ 711.632415] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.632415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.650879] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 711.651169] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 711.651902] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.652572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.653658] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 711.653658] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 711.653658] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.654180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.654303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.654389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.654668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.654888] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.655059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.655153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.655371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.655461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.655556] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.656831] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.656969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.657030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.657263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.657411] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.657505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.657589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.658072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.658190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.658287] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.661645] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c88d4f38-1603-42ee-adaa-ea1bc512961b with status ACTIVE [ 711.661645] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.661645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.661645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.666183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.666183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.666183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.666183] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c88d4f38-1603-42ee-adaa-ea1bc512961b is going to be updated. [ 711.689319] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.691018] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf already deleted. [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.691018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.691018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.692714] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.692839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.692876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.693047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.696070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.696325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c88d4f38-1603-42ee-adaa-ea1bc512961b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.962569] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_rules [ 711.962569] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 711.962569] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 711.962569] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 711.962569] env[69728]: INFO networking_nsxv3.common.synchronization [req-e682f2be-0277-46e3-b1a6-e1cbce5f4478 req-7112a91a-1245-425c-b7a6-ef5f88cdc9d4 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: e08c0362-c640-4658-b7bb-a4309abee8c6 with Priority: HIGHEST for action port [ 711.962569] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_rules [ 711.963709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 711.963709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08c0362-c640-4658-b7bb-a4309abee8c6 with Priority: HIGHEST for action port [ 711.963709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 711.963709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 711.967579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.967579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.967579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.967579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.967579] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.967579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.967579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.967579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.967579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.967579] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.968260] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e08c0362-c640-4658-b7bb-a4309abee8c6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.968260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.968260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.968260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.968260] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e08c0362-c640-4658-b7bb-a4309abee8c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.969139] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.969235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.969411] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.969494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.160102] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.161543] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.170781] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.219507] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.219507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.219507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.219507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.219507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.219507] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf already deleted. [ 712.219507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.278266] env[69728]: INFO networking_nsxv3.common.synchronization [req-7cedc6ff-58ef-46cb-9a7b-0da6137323a1 req-ed348416-4a61-4004-9d1b-c2b0b3437f70 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 712.278953] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 712.279094] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.279216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.279285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.279534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.279690] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.279789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.279850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.280634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.280634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.280758] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.471544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.473270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.473270] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b11f6860-8f7f-4661-9efd-97f648172b15 None None] Enqueued Resource ID: 7ae532bf-f239-456b-83d1-0a7c0ab3b816 with Priority: HIGHEST for action port [ 712.474205] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.474459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.479124] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e08c0362-c640-4658-b7bb-a4309abee8c6 with status ACTIVE [ 712.479124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.479124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.479124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.479124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.479124] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e08c0362-c640-4658-b7bb-a4309abee8c6 is going to be updated. [ 712.480235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae532bf-f239-456b-83d1-0a7c0ab3b816 with Priority: HIGHEST for action port [ 712.480679] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ae532bf-f239-456b-83d1-0a7c0ab3b816 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.480949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ae532bf-f239-456b-83d1-0a7c0ab3b816" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.481151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ae532bf-f239-456b-83d1-0a7c0ab3b816" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.481463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ae532bf-f239-456b-83d1-0a7c0ab3b816" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.481659] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ae532bf-f239-456b-83d1-0a7c0ab3b816',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.501606] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.503376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.503376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.503376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.503376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.503376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.663779] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.665715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.665715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.665715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.665912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.665949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.666598] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 242249ee-0650-4468-83db-52fb528ae0d1 is going to be created. [ 712.677052] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.710106] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c07c53b9-b92a-425d-8250-b7f598ffd660 in Status: SUCCESS [ 712.710277] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c07c53b9-b92a-425d-8250-b7f598ffd660 deletion is rescheduled due to dependency. [ 712.714400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.715327] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.715498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.715606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.715739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.715887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.725151] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 242249ee-0650-4468-83db-52fb528ae0d1 in Status: UNINITIALIZED for 2s [ 712.783615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.783785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.783907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.785027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.785027] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 already deleted. [ 712.785027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.985053] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ae532bf-f239-456b-83d1-0a7c0ab3b816 [ 712.985301] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.985880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.985880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.985880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.985880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.986198] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ae532bf-f239-456b-83d1-0a7c0ab3b816 already deleted. [ 712.986198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ae532bf-f239-456b-83d1-0a7c0ab3b816" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.172558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.172558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.172558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.172980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.172980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.172980] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 713.182251] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.182251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.182251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.182251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.182251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.182251] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be created. [ 713.203597] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.203750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.203823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.204035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.204199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.209150] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.209150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.209150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.209150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.209150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.227603] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: UNINITIALIZED for 2s [ 713.228368] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 713.456027] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.456027] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.456027] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.456027] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.456580] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.457030] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.457340] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.457818] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.458816] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.460407] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.460407] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.460522] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.460638] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.460772] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.460858] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.461012] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.482972] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.483085] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.483218] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.483400] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.483720] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-21927fec-c37b-4d90-b30b-df53083cdcee taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.483915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.484059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.484396] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.484537] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21927fec-c37b-4d90-b30b-df53083cdcee',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.554711] env[69728]: INFO networking_nsxv3.common.synchronization [None req-69e979cb-b78f-47c8-94b7-9b2a0bb4c3d7 None None] Enqueued Resource ID: a34be870-9f54-42ac-856d-2de74c0b9fcc with Priority: HIGHEST for action port [ 713.555470] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34be870-9f54-42ac-856d-2de74c0b9fcc with Priority: HIGHEST for action port [ 713.555770] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a34be870-9f54-42ac-856d-2de74c0b9fcc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.555904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a34be870-9f54-42ac-856d-2de74c0b9fcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.555972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a34be870-9f54-42ac-856d-2de74c0b9fcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.559976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a34be870-9f54-42ac-856d-2de74c0b9fcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.559976] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a34be870-9f54-42ac-856d-2de74c0b9fcc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.989068] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.989618] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.989792] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.990287] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.990671] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.990671] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 21927fec-c37b-4d90-b30b-df53083cdcee not found, creating... [ 713.990975] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.991268] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.991623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.991915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.992128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.992631] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.992876] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.993036] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.993293] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.994402] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.994402] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 21927fec-c37b-4d90-b30b-df53083cdcee is going to be created. [ 714.012252] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.014037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.014037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.014037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.014206] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.014317] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.064936] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a34be870-9f54-42ac-856d-2de74c0b9fcc [ 714.064936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.066090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.066090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.066090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.066223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.066223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a34be870-9f54-42ac-856d-2de74c0b9fcc already deleted. [ 714.066292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a34be870-9f54-42ac-856d-2de74c0b9fcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.452649] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7a39d004-ffa9-4a37-84eb-2f27eff761d0 None None] Enqueued Resource ID: b08796f8-8879-433e-a68c-9aad03a4e5c3 with Priority: HIGHEST for action port [ 714.453098] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b08796f8-8879-433e-a68c-9aad03a4e5c3 with Priority: HIGHEST for action port [ 714.453623] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b08796f8-8879-433e-a68c-9aad03a4e5c3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.453749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b08796f8-8879-433e-a68c-9aad03a4e5c3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.453840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b08796f8-8879-433e-a68c-9aad03a4e5c3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.454128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b08796f8-8879-433e-a68c-9aad03a4e5c3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.454229] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b08796f8-8879-433e-a68c-9aad03a4e5c3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.529325] env[69728]: INFO networking_nsxv3.common.synchronization [None req-2c096abe-9be3-43ab-ba0c-56db0efee267 None None] Enqueued Resource ID: 17e06cba-443a-4926-a6a1-166b774de18c with Priority: HIGHEST for action port [ 714.529325] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17e06cba-443a-4926-a6a1-166b774de18c with Priority: HIGHEST for action port [ 714.529325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-17e06cba-443a-4926-a6a1-166b774de18c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.529325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17e06cba-443a-4926-a6a1-166b774de18c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.529325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17e06cba-443a-4926-a6a1-166b774de18c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.530715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17e06cba-443a-4926-a6a1-166b774de18c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.530882] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e06cba-443a-4926-a6a1-166b774de18c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.734268] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 242249ee-0650-4468-83db-52fb528ae0d1 in Status: SUCCESS [ 714.734545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.734786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.735016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.735303] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.735411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.735411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.735529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.735610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.735695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.735805] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.814152] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 714.814152] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 714.814152] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_members [ 714.814152] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 714.814152] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 714.814152] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_members [ 714.814790] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.815072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.815378] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.815570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.816033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-447fcb82-2686-43bc-be85-02c4a3f9ea8f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.822455] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.822455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.822455] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.940794] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_rules [ 714.940958] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 714.941095] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_rules [ 714.941263] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_members [ 714.941397] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 714.941521] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 714.941644] env[69728]: INFO networking_nsxv3.common.synchronization [req-58d11911-0c30-486a-93c2-bdf52c0399a4 req-a074dc4a-0af5-4db4-91e7-0535f36bac00 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: e08c0362-c640-4658-b7bb-a4309abee8c6 with Priority: HIGHEST for action port [ 714.944996] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_rules [ 714.944996] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_rules [ 714.944996] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 714.944996] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e08c0362-c640-4658-b7bb-a4309abee8c6 with Priority: HIGHEST for action port [ 714.944996] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 714.945325] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 714.945325] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_members [ 714.945450] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.945549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.945897] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.945897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.945897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.946168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.946247] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.947552] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.947552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.947552] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e08c0362-c640-4658-b7bb-a4309abee8c6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.947802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.947802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.947908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.947908] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e08c0362-c640-4658-b7bb-a4309abee8c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.950723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.950723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.950723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.950723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.950723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-447fcb82-2686-43bc-be85-02c4a3f9ea8f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.950723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.957413] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b08796f8-8879-433e-a68c-9aad03a4e5c3 [ 714.957413] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.957413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.957413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.957413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.957413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.957413] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b08796f8-8879-433e-a68c-9aad03a4e5c3 already deleted. [ 714.957413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b08796f8-8879-433e-a68c-9aad03a4e5c3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.035078] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17e06cba-443a-4926-a6a1-166b774de18c [ 715.035078] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.035078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.035078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.035078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.035078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.035078] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17e06cba-443a-4926-a6a1-166b774de18c already deleted. [ 715.035078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17e06cba-443a-4926-a6a1-166b774de18c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.096689] env[69728]: INFO networking_nsxv3.common.synchronization [req-7cedc6ff-58ef-46cb-9a7b-0da6137323a1 req-c640350d-1108-41d1-b39f-5108c0ef2733 service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 715.096689] env[69728]: INFO networking_nsxv3.common.synchronization [req-7cedc6ff-58ef-46cb-9a7b-0da6137323a1 req-c640350d-1108-41d1-b39f-5108c0ef2733 service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 715.096689] env[69728]: INFO networking_nsxv3.common.synchronization [req-7cedc6ff-58ef-46cb-9a7b-0da6137323a1 req-c640350d-1108-41d1-b39f-5108c0ef2733 service nova] Enqueued Resource ID: 21927fec-c37b-4d90-b30b-df53083cdcee with Priority: HIGHEST for action port [ 715.097895] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 715.098441] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 715.098441] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21927fec-c37b-4d90-b30b-df53083cdcee with Priority: HIGHEST for action port [ 715.109259] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.109259] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.109259] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.109259] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.109259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.109259] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.109751] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-21927fec-c37b-4d90-b30b-df53083cdcee taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.109751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.109829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.110777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.110777] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21927fec-c37b-4d90-b30b-df53083cdcee',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.237918] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 715.238160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.239161] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.239336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.239442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.239739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.239870] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.239972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.240692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.240888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.240976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.241087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.241239] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.241333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.241393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.241541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.241677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.241766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.241826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.241967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.242074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.244412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.244412] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.245131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.245502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.245502] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.245629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.245629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.246836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.246836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.246836] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.253471] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.253471] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.253471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.253471] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.325043] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.455263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e08c0362-c640-4658-b7bb-a4309abee8c6 with status ACTIVE [ 715.455263] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.455263] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.455263] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.455263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.455263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e08c0362-c640-4658-b7bb-a4309abee8c6 is going to be updated. [ 715.456520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-447fcb82-2686-43bc-be85-02c4a3f9ea8f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.459745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.476499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.476653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.476722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.476929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.477085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.477241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e08c0362-c640-4658-b7bb-a4309abee8c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.549357] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ed3f409-07b2-41a8-9f62-4891256380e3 req-ff3cc8a1-846c-4e95-95f9-8b1a6ce810f6 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_members [ 715.549583] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_members [ 715.550416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.550416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.551206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.551682] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.551738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.551891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.552044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.552276] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.622112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.622112] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21927fec-c37b-4d90-b30b-df53083cdcee with status ACTIVE [ 715.622112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.622112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.622112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.622995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.622995] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.622995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.622995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.622995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.622995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.622995] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21927fec-c37b-4d90-b30b-df53083cdcee is going to be updated. [ 715.623892] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.653468] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.653468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.653468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.653468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.653468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.653468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21927fec-c37b-4d90-b30b-df53083cdcee" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.753587] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 242249ee-0650-4468-83db-52fb528ae0d1: rpc.has_security_group_logging(os_id): False [ 715.754830] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.755831] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.782284] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.782415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.782478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.782685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.782800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.783040] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.783143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.783207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.783360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.783435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.783622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.783704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.783855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.783900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.784055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.784195] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.784308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.784348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.784558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.785119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.785119] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 242249ee-0650-4468-83db-52fb528ae0d1 is going to be created. [ 715.830021] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.845179] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.845322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.845387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.845609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.845825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.853272] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6bbe5e75-41db-42f5-a41a-98dd8d227a18 None None] Enqueued Resource ID: c58e7161-7ae4-4838-bc1e-cf8d2b786522 with Priority: HIGHEST for action port [ 715.853864] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c58e7161-7ae4-4838-bc1e-cf8d2b786522 with Priority: HIGHEST for action port [ 715.856768] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c58e7161-7ae4-4838-bc1e-cf8d2b786522 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.856768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c58e7161-7ae4-4838-bc1e-cf8d2b786522" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.856768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c58e7161-7ae4-4838-bc1e-cf8d2b786522" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.856768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c58e7161-7ae4-4838-bc1e-cf8d2b786522" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.856768] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c58e7161-7ae4-4838-bc1e-cf8d2b786522',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.859759] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 242249ee-0650-4468-83db-52fb528ae0d1 in Status: IN_PROGRESS for 2s [ 715.921040] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.921040] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.921040] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.921040] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.921040] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.921790] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.922218] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.925037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.925037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.925037] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.925037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.925037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.925037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.925037] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.925037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.925037] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.945021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.945021] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.945021] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.945021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.945021] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-9e93006f-b8f2-482e-8857-d4dea71f9640 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.945021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.945021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.946074] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.946391] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e93006f-b8f2-482e-8857-d4dea71f9640',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.056532] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.056707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.056783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.057016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.057175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.057373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.057470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.057535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.057738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.057830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.057919] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 already deleted. [ 716.058015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.130992] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.262833] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.262833] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.329771] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.329986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.329986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.330256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.330344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.330530] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f is going to be created. [ 716.351804] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.351964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.353798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.354168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.354416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.358163] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c58e7161-7ae4-4838-bc1e-cf8d2b786522 [ 716.358400] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.358534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.358601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.358840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.358932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.359096] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c58e7161-7ae4-4838-bc1e-cf8d2b786522 already deleted. [ 716.359142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c58e7161-7ae4-4838-bc1e-cf8d2b786522" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.367029] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: UNINITIALIZED for 2s [ 716.450023] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.450345] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.450493] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.450815] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.450967] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.451154] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 9e93006f-b8f2-482e-8857-d4dea71f9640 not found, creating... [ 716.451468] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.451726] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.451860] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.452107] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.452271] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.452591] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.452751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.452913] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.457376] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.457809] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.457809] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 9e93006f-b8f2-482e-8857-d4dea71f9640 is going to be created. [ 716.477205] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.477443] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.477569] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.477966] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.478215] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.478453] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.635933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.636800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.636800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.636800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.636800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.636800] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be created. [ 716.682021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.682021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.682021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.682021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.682021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.688609] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: UNINITIALIZED for 2s [ 716.767270] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.767430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.767503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.767780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.767914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.767982] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 716.769279] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.769394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.769472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.769637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.769718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.769808] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be updated. [ 716.799573] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.799838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.799838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.800018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.800197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.802652] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.802652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.802788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.802884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.803014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.814017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: IN_PROGRESS for 2s [ 716.814459] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 717.227560] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ed3f409-07b2-41a8-9f62-4891256380e3 req-142523c4-7918-42ce-8cdc-c507af313071 service nova] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_rules [ 717.228308] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ed3f409-07b2-41a8-9f62-4891256380e3 req-142523c4-7918-42ce-8cdc-c507af313071 service nova] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_members [ 717.228308] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ed3f409-07b2-41a8-9f62-4891256380e3 req-142523c4-7918-42ce-8cdc-c507af313071 service nova] Enqueued Resource ID: 9e93006f-b8f2-482e-8857-d4dea71f9640 with Priority: HIGHEST for action port [ 717.228308] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_rules [ 717.228308] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_members [ 717.228695] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e93006f-b8f2-482e-8857-d4dea71f9640 with Priority: HIGHEST for action port [ 717.228988] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.231316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.231316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.231316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.231426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.232628] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.232628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.232628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.232628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.232888] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.232888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.232888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.233061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.233123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.233214] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.235354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e93006f-b8f2-482e-8857-d4dea71f9640 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.235354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.235354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.235555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.235555] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e93006f-b8f2-482e-8857-d4dea71f9640',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.736590] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.737855] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.737977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.738193] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e93006f-b8f2-482e-8857-d4dea71f9640 with status ACTIVE [ 717.738345] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.738570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.738570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.738764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.738917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.739414] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.739414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.739414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.739701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.739701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.739873] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.740065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.741196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.742075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.742075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.742075] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e93006f-b8f2-482e-8857-d4dea71f9640 is going to be updated. [ 717.764357] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.764950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.765586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.766135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.766135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.766483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e93006f-b8f2-482e-8857-d4dea71f9640" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.881475] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 242249ee-0650-4468-83db-52fb528ae0d1 in Status: SUCCESS [ 717.881709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.892756] env[69728]: INFO networking_nsxv3.common.synchronization [req-5f1c074b-6654-47e2-b735-76413a8dacfd req-22f24f16-8acc-4628-a730-1b6849c6bdde tempest-ServersWithSpecificFlavorTestJSON-1321527697 tempest-ServersWithSpecificFlavorTestJSON-1321527697-project-member] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 717.893458] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 717.893776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.893977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.894031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.894371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.894532] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.894728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.894728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.894879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.894968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.895075] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.195611] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.195611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.195611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.195801] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.195977] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.196153] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.196363] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.196497] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.196826] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.196902] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.196941] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.197058] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.197164] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.197316] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 718.197383] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.197620] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.228727] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.228963] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 718.230048] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.230048] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.230048] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-08468ebb-8d7d-44c3-9bcd-5131848c569a taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.230048] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.230048] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.230274] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.230362] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08468ebb-8d7d-44c3-9bcd-5131848c569a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.243401] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.397610] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.397828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.397917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.398142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.398239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.398436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.398534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.398596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.398746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.398822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.398905] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 already deleted. [ 718.398985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.456594] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: SUCCESS [ 718.456818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.456969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.457202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.457389] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.457503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.457567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.457714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.457855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.457954] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.701919] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.701919] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.701919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.701919] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.734737] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.734958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.735127] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.735409] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.735552] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.736039] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 08468ebb-8d7d-44c3-9bcd-5131848c569a not found, creating... [ 718.736039] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.736185] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.736270] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.736494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.736630] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.736916] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.737081] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.737199] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.737410] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.737534] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.737679] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 08468ebb-8d7d-44c3-9bcd-5131848c569a is going to be created. [ 718.746407] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.746557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.746619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.746783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.746880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.746959] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 is going to be created. [ 718.758577] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.758769] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.758904] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.759181] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.759405] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.759620] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.768777] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.768926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.768980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.769239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.769335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.777482] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 in Status: UNINITIALIZED for 2s [ 718.826099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 718.826354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.827033] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 718.827204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.827351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.827570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.827803] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.827982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.828070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.828238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.828324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.828410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.828637] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.831631] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.831631] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.831631] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.831631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.832298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.832298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.832298] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.832459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.833642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.833642] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.833642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.833642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.833642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.833642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.833642] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.961096] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.085418] env[69728]: INFO networking_nsxv3.common.synchronization [req-cda5eaa6-5703-41af-bebf-8ccf6e9f37b5 req-ee22e195-1d2c-49ca-96de-0cba30b16d9f tempest-ServerDiagnosticsNegativeTest-627869311 tempest-ServerDiagnosticsNegativeTest-627869311-project-member] Enqueued Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_members [ 719.086052] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 with Priority: HIGHEST for action security_group_members [ 719.086412] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.086574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.086670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.087357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.087536] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.087666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.087800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.088032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.088158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.088287] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1bbb88c-d56a-4e1c-b39c-5f69921fcc29',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.204943] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.337587] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.337587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.337587] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.337587] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.337587] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.463346] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.477203] env[69728]: INFO networking_nsxv3.common.synchronization [req-5f1c074b-6654-47e2-b735-76413a8dacfd req-23ac2021-8a5b-4b79-a80d-7088ee494ebd service nova] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 719.477203] env[69728]: INFO networking_nsxv3.common.synchronization [req-5f1c074b-6654-47e2-b735-76413a8dacfd req-23ac2021-8a5b-4b79-a80d-7088ee494ebd service nova] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 719.477203] env[69728]: INFO networking_nsxv3.common.synchronization [req-5f1c074b-6654-47e2-b735-76413a8dacfd req-23ac2021-8a5b-4b79-a80d-7088ee494ebd service nova] Enqueued Resource ID: 08468ebb-8d7d-44c3-9bcd-5131848c569a with Priority: HIGHEST for action port [ 719.477203] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 719.477203] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 719.477203] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08468ebb-8d7d-44c3-9bcd-5131848c569a with Priority: HIGHEST for action port [ 719.477203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.477203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.477203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.478019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.478258] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.479343] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.479601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.479771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.480175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.480553] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.480791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.480987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.481335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.483105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.483105] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.483105] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-08468ebb-8d7d-44c3-9bcd-5131848c569a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.483105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.483105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.483105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.483105] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08468ebb-8d7d-44c3-9bcd-5131848c569a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.590810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.591080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.591224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.591424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.591550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.591856] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.592012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.592102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.592288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.592389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.592510] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 is going to be updated. [ 719.620978] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.621478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.621659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.622096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.622316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.631878] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 in Status: IN_PROGRESS for 2s [ 719.707915] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562643dd-522c-4927-b2ad-26c57a85d1e3: rpc.has_security_group_logging(os_id): False [ 719.748109] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.748109] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.748109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.752013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.752013] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be created. [ 719.835979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.836780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.836905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.837113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.837304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.838749] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.840358] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42bb2c30-1996-4c07-afc8-9d69bfd16f3a: rpc.has_security_group_logging(os_id): False [ 719.841552] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.853995] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 719.869612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.869612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.869612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.869612] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be created. [ 719.950904] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.951120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.951206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.951479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.951698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.968503] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.972408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.972408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.972408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.972408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.972408] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f is going to be updated. [ 719.973621] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: IN_PROGRESS for 2s [ 719.985613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.985860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.986136] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.987309] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08468ebb-8d7d-44c3-9bcd-5131848c569a with status ACTIVE [ 719.987567] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.987729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.987830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.988111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.988235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.988481] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.988615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.988702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.988919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.989041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.989689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.989689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.989689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.989689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.989895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.989895] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08468ebb-8d7d-44c3-9bcd-5131848c569a is going to be updated. [ 720.018465] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.018465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.018465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.018465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.018465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.034539] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: IN_PROGRESS for 2s [ 720.042066] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.042318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.042318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.042482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.042585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.042780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08468ebb-8d7d-44c3-9bcd-5131848c569a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.343334] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.343334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.343334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.343334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.343334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.343334] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 720.345169] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.346055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.346375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.346818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.350167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.350167] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be updated. [ 720.380028] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.380028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.380028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.380028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.380028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.382303] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.382800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.383045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.383422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.383738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.397092] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: IN_PROGRESS for 2s [ 720.397936] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 720.494017] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.789073] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 in Status: SUCCESS [ 720.789385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.789861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.789861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.789999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.789999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.790115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.790259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.790340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.790428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.790519] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.995106] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.995243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.995311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.995566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.995626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.995729] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be created. [ 721.018490] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.018761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.018761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.018937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.019487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.028589] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: UNINITIALIZED for 2s [ 721.293279] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.642710] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 in Status: SUCCESS [ 721.643238] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1bbb88c-d56a-4e1c-b39c-5f69921fcc29 deletion is rescheduled due to dependency. [ 721.643370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1bbb88c-d56a-4e1c-b39c-5f69921fcc29" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.795982] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 247ba3c8-bd52-444a-9315-c5fb1eb2aee6: rpc.has_security_group_logging(os_id): False [ 721.812949] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.813351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.813351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.813351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.813656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.813656] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.813807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.813807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.813931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.814022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.814118] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 is going to be created. [ 721.864552] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 721.864785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.866992] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.866992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.867164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.867289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.867464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.879415] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 in Status: IN_PROGRESS for 2s [ 721.995444] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 721.995678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.995896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.996142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.996238] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.049165] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: SUCCESS [ 722.049165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.049165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.049165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.049165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.049395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.049395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.049468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.049502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.049663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.049719] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.408816] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 722.409057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.409246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.409505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.410163] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.410163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.410163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.410163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.410163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.410567] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.412468] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 722.412761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.412839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.413129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.413205] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.413397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.413397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.413499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.413735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.413735] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.498369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.498535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.555024] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.915416] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.917034] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.993371] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c425237-3e24-48ad-9b7d-8037dced95b2 req-50e292aa-6f15-4b22-8080-88295eb187fb tempest-VolumesAssistedSnapshotsTest-955716078 tempest-VolumesAssistedSnapshotsTest-955716078-project-member] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_members [ 722.993371] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_members [ 722.993371] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.993371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.993371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.995091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.996385] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.996385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.996616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.996616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.996687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.996772] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.037831] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 723.038111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.038628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.038854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.039068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.039193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.039259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.039414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.039496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.039583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.039675] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.059678] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 447fcb82-2686-43bc-be85-02c4a3f9ea8f: rpc.has_security_group_logging(os_id): False [ 723.080485] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.080485] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.080485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.080485] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f is going to be created. [ 723.138314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.138769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.139153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.139153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.139380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.151278] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: IN_PROGRESS for 2s [ 723.420929] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.421979] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.498916] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.499129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.499203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.499420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.499510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.503024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.503024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.503024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.503024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.503024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.503024] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb already deleted. [ 723.503024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.541964] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.891605] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 in Status: SUCCESS [ 723.891605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.927578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.927578] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be updated. [ 723.927578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.927578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.927578] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 723.960547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.960712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.960712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.960964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.961139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.962871] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.962995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.964116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.964116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.964116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.973443] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-307 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.973674] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-307" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.973821] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-307" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.974279] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-307" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.975801] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.975801] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.975801] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.975801] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.976048] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.976492] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.976981] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.976981] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.976981] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.977284] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.977371] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.977572] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.980303] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: IN_PROGRESS for 2s [ 723.981208] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 724.002533] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.002609] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 724.003255] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.003500] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-307" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.003947] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-12c3b115-2472-436b-8eec-c832fef90a31 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.004226] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.004391] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.004967] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.005104] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12c3b115-2472-436b-8eec-c832fef90a31',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.045429] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32e70181-d90f-4f81-8e3c-980e1b53c1e6: rpc.has_security_group_logging(os_id): False [ 724.075200] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.075405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.075405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.075540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.075637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.075913] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.076061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.076139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.076354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.076668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.076668] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be created. [ 724.143077] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.143077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.143077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.143077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.143077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.151718] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 724.509332] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.510339] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.510339] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.510492] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.510638] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.510797] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 12c3b115-2472-436b-8eec-c832fef90a31 not found, creating... [ 724.511263] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.511371] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.511414] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.512037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.512037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.512161] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.512300] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.512434] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.512656] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.512796] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.513307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 12c3b115-2472-436b-8eec-c832fef90a31 is going to be created. [ 724.531908] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.532138] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.532266] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.532550] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.532776] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.533032] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.164125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: SUCCESS [ 725.164473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.582496] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c425237-3e24-48ad-9b7d-8037dced95b2 req-96f6d5ed-c2e3-43cc-9bcb-bed50eac6fae service nova] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_rules [ 725.582496] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c425237-3e24-48ad-9b7d-8037dced95b2 req-96f6d5ed-c2e3-43cc-9bcb-bed50eac6fae service nova] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_members [ 725.582496] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c425237-3e24-48ad-9b7d-8037dced95b2 req-96f6d5ed-c2e3-43cc-9bcb-bed50eac6fae service nova] Enqueued Resource ID: 12c3b115-2472-436b-8eec-c832fef90a31 with Priority: HIGHEST for action port [ 725.582625] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_rules [ 725.582755] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_members [ 725.582826] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12c3b115-2472-436b-8eec-c832fef90a31 with Priority: HIGHEST for action port [ 725.584505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.584505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.584505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.584730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.584797] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.586754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.586754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.586754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.586754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.586754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.587171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.587171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.587171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.587171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.587364] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.588145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-12c3b115-2472-436b-8eec-c832fef90a31 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.591031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.591031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.591031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.591031] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12c3b115-2472-436b-8eec-c832fef90a31',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.992745] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.994515] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.994515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.994515] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.000021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.000021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.000021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.000021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.000021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.001920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.002339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.002652] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.090657] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.091530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.092221] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.093460] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12c3b115-2472-436b-8eec-c832fef90a31 with status ACTIVE [ 726.093519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.093638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.093706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.093911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.094009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.094189] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.094286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.094346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.094500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.094585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.094765] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.094861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.094922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.095078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.095242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.096059] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12c3b115-2472-436b-8eec-c832fef90a31 is going to be updated. [ 726.120027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.120232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.121112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.121112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.121112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.121112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12c3b115-2472-436b-8eec-c832fef90a31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.170987] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 726.171292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.507090] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.508097] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e3be409-32bc-4a01-bfa9-d2153d5679f3: rpc.has_security_group_logging(os_id): False [ 726.524865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.525014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.525088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.525356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.525451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.525653] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.525955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.525955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.526047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.526109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.526302] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.526394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.526454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.526594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.526715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.526847] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.526938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.526986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.527651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.527741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.527854] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 726.582746] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.582910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.582959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.583182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.583398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.596275] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 726.598607] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.927578] env[69728]: INFO networking_nsxv3.common.synchronization [None req-37ffb04f-2d78-4331-bafc-5283af4441bd None None] Enqueued Resource ID: 6b2b7d74-2ecb-4adf-a560-accb99d194dc with Priority: HIGHEST for action port [ 726.928742] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b2b7d74-2ecb-4adf-a560-accb99d194dc with Priority: HIGHEST for action port [ 726.929467] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b2b7d74-2ecb-4adf-a560-accb99d194dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.931837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b2b7d74-2ecb-4adf-a560-accb99d194dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.931837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b2b7d74-2ecb-4adf-a560-accb99d194dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.931837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b2b7d74-2ecb-4adf-a560-accb99d194dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.931837] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2b7d74-2ecb-4adf-a560-accb99d194dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.011761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42bb2c30-1996-4c07-afc8-9d69bfd16f3a: rpc.has_security_group_logging(os_id): False [ 727.030073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.030073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.030073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.030073] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be updated. [ 727.077110] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.077110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.077110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.077110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.077110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.087134] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: IN_PROGRESS for 2s [ 727.101646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.101803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.101866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.102422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.102422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.102422] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb is going to be created. [ 727.122806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.122998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.123095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.123294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.123456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.134694] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 875b1121-9a68-45f5-9b21-ff23d886dadb in Status: UNINITIALIZED for 2s [ 727.434223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b2b7d74-2ecb-4adf-a560-accb99d194dc [ 727.434223] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b2b7d74-2ecb-4adf-a560-accb99d194dc already deleted. [ 727.434223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b2b7d74-2ecb-4adf-a560-accb99d194dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.593411] env[69728]: INFO networking_nsxv3.common.synchronization [req-9623cd00-3fa4-4205-a5ed-5e708355121b req-008f54b1-fcbf-484d-833b-3995735dd0c5 tempest-ServerDiagnosticsTest-7361437 tempest-ServerDiagnosticsTest-7361437-project-member] Enqueued Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_members [ 728.593411] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_members [ 728.593411] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.593917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.593917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.597844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.597844] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.597844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.597844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.598060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.598101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.598195] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.611839] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 728.611839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.611839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.611839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.611839] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.103184] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 729.103302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.103648] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.103771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.103949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.104107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.104143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.104320] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.104417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.104466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.105588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.105588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.105588] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc already deleted. [ 729.105588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.113448] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.113587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.113626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.113900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.113982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.114095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.114160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.114313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.114399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.114487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.114579] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.150618] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 875b1121-9a68-45f5-9b21-ff23d886dadb in Status: SUCCESS [ 729.150618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.150618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.150768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.150890] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.150962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.151013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.151197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.151254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.151343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.151439] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.460047] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.460047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.460047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.460047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.460047] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.460047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.460047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.460835] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.461111] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.461650] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.461881] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.462095] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.462314] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.462515] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.462763] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.463163] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.470411] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7f252a57-edbd-4d4d-89a8-817b75a7ce79 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 729.470411] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 729.471116] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.471670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.471978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.472947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.473186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.484833] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.485032] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.485427] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.486547] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.486547] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-a3967ad9-55c2-4e27-a039-258774490653 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.488018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.488018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.488018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.488018] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3967ad9-55c2-4e27-a039-258774490653',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.525386] env[69728]: INFO networking_nsxv3.common.synchronization [None req-d7c5b814-e826-43e0-a032-023bd7d620fd None None] Enqueued Resource ID: b38b929c-63f8-41a3-8bb2-bd9dd159226a with Priority: HIGHEST for action port [ 729.525386] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b38b929c-63f8-41a3-8bb2-bd9dd159226a with Priority: HIGHEST for action port [ 729.525906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b38b929c-63f8-41a3-8bb2-bd9dd159226a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.526049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b38b929c-63f8-41a3-8bb2-bd9dd159226a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.526117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b38b929c-63f8-41a3-8bb2-bd9dd159226a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.526365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b38b929c-63f8-41a3-8bb2-bd9dd159226a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.526437] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b38b929c-63f8-41a3-8bb2-bd9dd159226a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.580615] env[69728]: INFO networking_nsxv3.common.synchronization [req-bc19194b-8640-4127-aa3c-227b1e6d7aef req-3d690695-5818-446e-96c9-a469b89095eb tempest-TenantUsagesTestJSON-324771647 tempest-TenantUsagesTestJSON-324771647-project-member] Enqueued Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_members [ 729.581328] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 242249ee-0650-4468-83db-52fb528ae0d1 with Priority: HIGHEST for action security_group_members [ 729.581440] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-242249ee-0650-4468-83db-52fb528ae0d1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.581560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.581630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.581832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.581986] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.582602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.582678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.582832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.582921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.583041] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('242249ee-0650-4468-83db-52fb528ae0d1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.622016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.622016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.622016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.622016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.622016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.623034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.623034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.623034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.623034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.623034] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.654804] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.686290] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a4cd359b-e836-49ee-8a87-c70e68083a9d tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 729.686290] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 729.686290] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.686290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.990998] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.991561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.991561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.991733] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.991733] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.991890] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port a3967ad9-55c2-4e27-a039-258774490653 not found, creating... [ 729.992261] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.993013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.993013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.993013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.993013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.993172] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.993323] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.993434] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.994254] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.994254] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.994254] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: a3967ad9-55c2-4e27-a039-258774490653 is going to be created. [ 729.999038] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.999038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.999038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.999423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.999423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.999423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf already deleted. [ 729.999571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.999613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.999769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.999853] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.017331] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.017538] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.017657] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.017984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.019245] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.019245] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.028611] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b38b929c-63f8-41a3-8bb2-bd9dd159226a [ 730.028912] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.028978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.029025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.029224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.029310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.029400] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b38b929c-63f8-41a3-8bb2-bd9dd159226a already deleted. [ 730.029482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b38b929c-63f8-41a3-8bb2-bd9dd159226a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.086357] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.086562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.086618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.086801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.087057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.087105] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.087183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.087252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.087439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.087522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.087612] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 242249ee-0650-4468-83db-52fb528ae0d1 is going to be updated. [ 730.125569] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e3be409-32bc-4a01-bfa9-d2153d5679f3: rpc.has_security_group_logging(os_id): False [ 730.138237] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.138237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.138364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.138504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.138689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.147877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.147998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.148199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.148638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.148638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.148638] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.148638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.148818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.148851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.148923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.149129] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.149217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.149278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.149417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.149502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.149694] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.149797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.149850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.149991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.150185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.150311] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 730.153607] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 242249ee-0650-4468-83db-52fb528ae0d1 in Status: IN_PROGRESS for 2s [ 730.159956] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 875b1121-9a68-45f5-9b21-ff23d886dadb: rpc.has_security_group_logging(os_id): False [ 730.182148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.182422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.182515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.183248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.183248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.184219] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.184388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.184482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.184701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.184800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.184925] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb is going to be created. [ 730.228218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.228348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.228418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.228636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.228774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.243868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 730.259519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.259726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.259801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.260083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.260350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.272503] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 875b1121-9a68-45f5-9b21-ff23d886dadb in Status: IN_PROGRESS for 2s [ 730.524631] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.525582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.525582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.525582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.525582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.525582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf already deleted. [ 730.525582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.837950] env[69728]: INFO networking_nsxv3.common.synchronization [req-b86bcc87-2b67-437d-bec4-8f548e99772a req-9d2483a9-2880-4a79-8da4-8d73f8cf8c08 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 730.838985] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 730.840162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.840540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.840744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.841094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.841401] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.841708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.841847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.842103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.842271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.842439] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.344782] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.344953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.345065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.345352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.345478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.345722] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.346024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.346118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.347036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.347036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.347036] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc already deleted. [ 731.347036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.370975] env[69728]: INFO networking_nsxv3.common.synchronization [req-9623cd00-3fa4-4205-a5ed-5e708355121b req-21665053-7413-4e6f-b531-2bfc88b98ca4 service nova] Enqueued Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_rules [ 731.371051] env[69728]: INFO networking_nsxv3.common.synchronization [req-9623cd00-3fa4-4205-a5ed-5e708355121b req-21665053-7413-4e6f-b531-2bfc88b98ca4 service nova] Enqueued Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_members [ 731.371493] env[69728]: INFO networking_nsxv3.common.synchronization [req-9623cd00-3fa4-4205-a5ed-5e708355121b req-21665053-7413-4e6f-b531-2bfc88b98ca4 service nova] Enqueued Resource ID: a3967ad9-55c2-4e27-a039-258774490653 with Priority: HIGHEST for action port [ 731.371493] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_rules [ 731.371721] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_members [ 731.371721] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3967ad9-55c2-4e27-a039-258774490653 with Priority: HIGHEST for action port [ 731.372728] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.372915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.372915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.373408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.373938] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.375977] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.376157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.376212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.377020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.377020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.377020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.377020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.377020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.377020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.377486] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.378253] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3967ad9-55c2-4e27-a039-258774490653 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.378351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.378420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.378584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.378661] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3967ad9-55c2-4e27-a039-258774490653',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.690533] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.690835] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.690986] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.691410] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.691714] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.691880] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.691999] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.692560] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.692560] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.692667] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.692701] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.692802] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.692909] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.693046] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 731.694035] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.694035] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.712965] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.713638] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 731.713638] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.714279] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.714279] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-73a735e9-a162-45a4-9e8a-922876d6d49d taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.714510] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.714633] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.715216] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.715353] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a735e9-a162-45a4-9e8a-922876d6d49d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.882354] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.882354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.882354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.882354] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3967ad9-55c2-4e27-a039-258774490653 with status ACTIVE [ 731.882354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.882354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.882354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.882354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.882354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.882796] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.882796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.882796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.882796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.883481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.883706] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.883898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.883997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.884228] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.884356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.884533] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3967ad9-55c2-4e27-a039-258774490653 is going to be updated. [ 731.904630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.905684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.905930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.906094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.906241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.906417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3967ad9-55c2-4e27-a039-258774490653" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.162658] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 242249ee-0650-4468-83db-52fb528ae0d1 in Status: SUCCESS [ 732.162853] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 242249ee-0650-4468-83db-52fb528ae0d1 deletion is rescheduled due to dependency. [ 732.163052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-242249ee-0650-4468-83db-52fb528ae0d1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.219719] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.219947] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.220083] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.220363] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.221758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.221758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 73a735e9-a162-45a4-9e8a-922876d6d49d not found, creating... [ 732.221758] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.221758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.221758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.221758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.221758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.222152] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.222152] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.222152] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.222284] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.222411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.222547] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 73a735e9-a162-45a4-9e8a-922876d6d49d is going to be created. [ 732.244199] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.244199] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.244199] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.244442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.248389] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.248389] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.262510] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 732.262510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.283352] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 875b1121-9a68-45f5-9b21-ff23d886dadb in Status: SUCCESS [ 732.283773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.382197] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.885267] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.885537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.886325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.888979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.888979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.888979] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc is going to be created. [ 732.912793] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.912793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.912793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.912952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.914855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.922656] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc in Status: UNINITIALIZED for 2s [ 733.207088] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c330e2f-d9b9-428a-9f4a-59bcf69be1d9 req-79517da0-3d09-46da-8245-2ccb36de8587 tempest-InstanceActionsNegativeTestJSON-539763132 tempest-InstanceActionsNegativeTestJSON-539763132-project-member] Enqueued Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_members [ 733.207832] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_members [ 733.208276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.208467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.208581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.208876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.209119] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.209276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.209441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.209581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.209707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.209844] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.517172] env[69728]: INFO networking_nsxv3.common.synchronization [req-b86bcc87-2b67-437d-bec4-8f548e99772a req-65ee4719-2c05-46d0-bb58-8b049cc963bd service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 733.517172] env[69728]: INFO networking_nsxv3.common.synchronization [req-b86bcc87-2b67-437d-bec4-8f548e99772a req-65ee4719-2c05-46d0-bb58-8b049cc963bd service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 733.517172] env[69728]: INFO networking_nsxv3.common.synchronization [req-b86bcc87-2b67-437d-bec4-8f548e99772a req-65ee4719-2c05-46d0-bb58-8b049cc963bd service nova] Enqueued Resource ID: 73a735e9-a162-45a4-9e8a-922876d6d49d with Priority: HIGHEST for action port [ 733.517172] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 733.517172] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 733.517172] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a735e9-a162-45a4-9e8a-922876d6d49d with Priority: HIGHEST for action port [ 733.517172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.517587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.517778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.518172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.518481] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.519582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.525147] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.525147] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.525147] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-73a735e9-a162-45a4-9e8a-922876d6d49d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.525147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.528290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.528290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.528290] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a735e9-a162-45a4-9e8a-922876d6d49d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.713071] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.713071] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.713071] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 already deleted. [ 733.713071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.947485] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-85 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.947485] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-85" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.947485] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-85" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.947485] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-85" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.947485] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.947485] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.949018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.950873] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.951213] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.951880] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.951880] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.951880] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.951880] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.952119] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 733.952306] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.952540] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.975071] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.975316] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 733.975555] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.975864] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-85" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.976380] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-5bf62784-846b-4179-855a-7d71aabd39d8 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.976664] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.976860] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.977402] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.977650] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf62784-846b-4179-855a-7d71aabd39d8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.031985] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.032662] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.033786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.034163] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73a735e9-a162-45a4-9e8a-922876d6d49d with status ACTIVE [ 734.037042] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.037042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.037042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.038059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.038179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.038369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.038490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.038599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.038745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.038821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.039142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.039278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.039408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.039546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.039639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.039770] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73a735e9-a162-45a4-9e8a-922876d6d49d is going to be updated. [ 734.061347] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.061347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.061347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.061347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.061347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.061347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73a735e9-a162-45a4-9e8a-922876d6d49d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.107025] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5e17c683-c713-4455-b000-3c765898aa4e None None] Enqueued Resource ID: e60b8fbb-5859-4858-9f93-bd0f6de00142 with Priority: HIGHEST for action port [ 734.107025] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e60b8fbb-5859-4858-9f93-bd0f6de00142 with Priority: HIGHEST for action port [ 734.107025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e60b8fbb-5859-4858-9f93-bd0f6de00142 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.107025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e60b8fbb-5859-4858-9f93-bd0f6de00142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.107025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e60b8fbb-5859-4858-9f93-bd0f6de00142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.108318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e60b8fbb-5859-4858-9f93-bd0f6de00142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.108607] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e60b8fbb-5859-4858-9f93-bd0f6de00142',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.480288] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.480535] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.480662] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.480946] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.481516] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.481516] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 5bf62784-846b-4179-855a-7d71aabd39d8 not found, creating... [ 734.481819] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.481819] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.481905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.482076] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.482658] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.482658] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.482658] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.482916] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.483020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.483189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.483263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 5bf62784-846b-4179-855a-7d71aabd39d8 is going to be created. [ 734.503715] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.503852] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.504373] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.504373] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.504477] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.505035] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.542530] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.612695] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e60b8fbb-5859-4858-9f93-bd0f6de00142 [ 734.612695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.612695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.612695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.612892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.612952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.613493] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e60b8fbb-5859-4858-9f93-bd0f6de00142 already deleted. [ 734.613493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e60b8fbb-5859-4858-9f93-bd0f6de00142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.933128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc in Status: SUCCESS [ 734.933501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.933812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.934087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.934293] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.934470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.934512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.934658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.934754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.934839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.934934] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.047170] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.047170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.047170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.047170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.047170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.047170] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be created. [ 735.069769] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.069769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.069769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.069769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.069769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.079205] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: UNINITIALIZED for 2s [ 735.438307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.438307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.438307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.438307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.438307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.438307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.438307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.438677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.438677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.438736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.438936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.439085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.439177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.439383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.439588] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.439718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.439808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.440025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.440138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.440284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.440411] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.479255] env[69728]: INFO networking_nsxv3.common.synchronization [req-f989beae-1991-4fa8-a298-0600a165acbd req-a3e7a658-2b61-40a7-8e91-61455d624254 tempest-ServerTagsTestJSON-1995299048 tempest-ServerTagsTestJSON-1995299048-project-member] Enqueued Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_members [ 735.479797] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGHEST for action security_group_members [ 735.480119] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.482607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.482607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.482607] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.943589] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc: rpc.has_security_group_logging(os_id): False [ 735.965663] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c330e2f-d9b9-428a-9f4a-59bcf69be1d9 req-6fbe1878-229f-4c33-9caf-1402c5917de3 service nova] Enqueued Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_rules [ 735.965749] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c330e2f-d9b9-428a-9f4a-59bcf69be1d9 req-6fbe1878-229f-4c33-9caf-1402c5917de3 service nova] Enqueued Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_members [ 735.965844] env[69728]: INFO networking_nsxv3.common.synchronization [req-8c330e2f-d9b9-428a-9f4a-59bcf69be1d9 req-6fbe1878-229f-4c33-9caf-1402c5917de3 service nova] Enqueued Resource ID: 5bf62784-846b-4179-855a-7d71aabd39d8 with Priority: HIGHEST for action port [ 735.967732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.967732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.968660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.968660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.968660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.968660] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.968935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.968935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.969094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.969173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.969359] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.969451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.969512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.969653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.969726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.969910] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.973021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.973021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.973021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.973021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.973021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc is going to be created. [ 735.973021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_rules [ 735.973021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_members [ 735.973021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bf62784-846b-4179-855a-7d71aabd39d8 with Priority: HIGHEST for action port [ 735.973354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.973354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.973467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.973714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.973714] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.976452] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.976559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.976625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.976789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.976915] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.977021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.977082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.977223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.977299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.977387] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.978174] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bf62784-846b-4179-855a-7d71aabd39d8 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.978287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.978346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.978483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.978556] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bf62784-846b-4179-855a-7d71aabd39d8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.983966] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.984094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.984160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.984329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.984424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.984583] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.984674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.985520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.985520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.985520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.985520] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e37c97c7-2869-4890-a474-cbf964f85643 is going to be updated. [ 736.012286] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.012429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.012504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.012709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.012842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.024226] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e37c97c7-2869-4890-a474-cbf964f85643 in Status: IN_PROGRESS for 2s [ 736.045607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.045756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.045832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.046079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.046272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.074645] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc in Status: IN_PROGRESS for 2s [ 736.373582] env[69728]: INFO networking_nsxv3.common.synchronization [None req-63daa0da-887e-45df-ae9e-4d622cfb91a3 None None] Enqueued Resource ID: 2fa67199-e749-4ea2-879f-27087750044a with Priority: HIGHEST for action port [ 736.376052] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa67199-e749-4ea2-879f-27087750044a with Priority: HIGHEST for action port [ 736.376052] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa67199-e749-4ea2-879f-27087750044a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.376052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa67199-e749-4ea2-879f-27087750044a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.376052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa67199-e749-4ea2-879f-27087750044a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.376052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa67199-e749-4ea2-879f-27087750044a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.376052] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa67199-e749-4ea2-879f-27087750044a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.481235] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.485305] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.485740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.487999] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bf62784-846b-4179-855a-7d71aabd39d8 with status ACTIVE [ 736.487999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.487999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.487999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.487999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.487999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.487999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.488430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.488430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.488683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.488755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.489136] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.489215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.489599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.489599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.489599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.489708] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bf62784-846b-4179-855a-7d71aabd39d8 is going to be updated. [ 736.508952] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.509231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.509310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.509529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.509664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.509902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bf62784-846b-4179-855a-7d71aabd39d8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.686957] env[69728]: INFO networking_nsxv3.common.synchronization [req-e726efb2-3643-4316-adfc-05ae8e3599a1 req-aba1f89f-fcb5-4bb9-af6a-b2551672e8ca tempest-FloatingIPsAssociationNegativeTestJSON-1275738109 tempest-FloatingIPsAssociationNegativeTestJSON-1275738109-project-member] Enqueued Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_members [ 736.687841] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGHEST for action security_group_members [ 736.687841] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.688089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.688089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.688363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.688881] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.688881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.688881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.689098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.689098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.689246] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.880287] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fa67199-e749-4ea2-879f-27087750044a [ 736.880287] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.880287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.880287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.880287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.880512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.880512] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fa67199-e749-4ea2-879f-27087750044a already deleted. [ 736.880512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa67199-e749-4ea2-879f-27087750044a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.984262] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.091215] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 737.091215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.091215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.091502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.091728] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.091856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.091947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.092193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.092323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.092452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.092557] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.192942] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.193294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.193294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.193516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.193642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.193857] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.193962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.194038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.194783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.194894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.195514] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e is going to be updated. [ 737.225131] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.225315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.225868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.226105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.226306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.236912] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e in Status: IN_PROGRESS for 2s [ 737.487437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.487596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.488506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.488506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.488506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.488506] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 is going to be created. [ 737.509987] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.514029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.514029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.514029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.514029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.522376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 in Status: UNINITIALIZED for 2s [ 737.595298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.595479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.595551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.595778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.595965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.596082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.596153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.596322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.596444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.596556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.596754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.596797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.596849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.596999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.597156] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.597252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.597314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.597459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.597534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.597620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.597714] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.034523] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e37c97c7-2869-4890-a474-cbf964f85643 in Status: SUCCESS [ 738.034523] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e37c97c7-2869-4890-a474-cbf964f85643 deletion is rescheduled due to dependency. [ 738.034523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.091668] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc in Status: SUCCESS [ 738.091968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.101264] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc: rpc.has_security_group_logging(os_id): False [ 738.124030] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.124030] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.124030] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.124030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.124868] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.124868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.124868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.124868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.124868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.124868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be created. [ 738.183041] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.183217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.183289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.183520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.183714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.204197] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 739.250880] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e in Status: SUCCESS [ 739.250880] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e deletion is rescheduled due to dependency. [ 739.250880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.532609] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 in Status: SUCCESS [ 739.533237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.533418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.533640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.533838] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.533959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.534049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.534213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.534296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.534579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.534579] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.580109] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6e2d1195-c2bb-4f4e-b17b-b02e8da65537 None None] Enqueued Resource ID: d11b607f-fbf6-4b5a-bd19-204d8fdba060 with Priority: HIGHEST for action port [ 739.581537] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d11b607f-fbf6-4b5a-bd19-204d8fdba060 with Priority: HIGHEST for action port [ 739.581996] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-d11b607f-fbf6-4b5a-bd19-204d8fdba060 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.582184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d11b607f-fbf6-4b5a-bd19-204d8fdba060" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.582274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d11b607f-fbf6-4b5a-bd19-204d8fdba060" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.582681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d11b607f-fbf6-4b5a-bd19-204d8fdba060" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.582852] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d11b607f-fbf6-4b5a-bd19-204d8fdba060',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.040820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.040979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.041080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.041312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.041478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.041578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.041641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.041790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.041875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.041961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.042134] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.042222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.042280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.042420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.042551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.042637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.042695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.042828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.042900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.042977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.043075] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.086041] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d11b607f-fbf6-4b5a-bd19-204d8fdba060 [ 740.086857] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.086857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.086857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.086857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.086857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.087379] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d11b607f-fbf6-4b5a-bd19-204d8fdba060 already deleted. [ 740.087379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d11b607f-fbf6-4b5a-bd19-204d8fdba060" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.216959] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 740.216959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.547024] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b4ce391-586f-4e43-aae8-8f6f4baf13c7: rpc.has_security_group_logging(os_id): False [ 740.564112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.565842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.565937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.566220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.566317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.566568] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.566678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.566744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.566927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.567018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.567225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.567338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.567402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.567548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.567647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.567831] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.567925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.568022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.568683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.568805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.568966] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 is going to be created. [ 740.624704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.624890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.625031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.629026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.629026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.641041] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 in Status: IN_PROGRESS for 2s [ 741.771921] env[69728]: INFO networking_nsxv3.common.synchronization [None req-600323a0-8d64-4224-81d3-d9a57475435c None None] Enqueued Resource ID: 48049936-9e97-4e0f-be7c-f6f8d037fd23 with Priority: HIGHEST for action port [ 741.771921] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48049936-9e97-4e0f-be7c-f6f8d037fd23 with Priority: HIGHEST for action port [ 741.771921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-48049936-9e97-4e0f-be7c-f6f8d037fd23 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.771921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48049936-9e97-4e0f-be7c-f6f8d037fd23" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.772457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48049936-9e97-4e0f-be7c-f6f8d037fd23" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.773849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48049936-9e97-4e0f-be7c-f6f8d037fd23" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.773849] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48049936-9e97-4e0f-be7c-f6f8d037fd23',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.276271] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48049936-9e97-4e0f-be7c-f6f8d037fd23 [ 742.276271] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.276465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.276465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.276636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.277017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.277017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48049936-9e97-4e0f-be7c-f6f8d037fd23 already deleted. [ 742.277017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48049936-9e97-4e0f-be7c-f6f8d037fd23" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.475543] env[69728]: INFO networking_nsxv3.common.synchronization [None req-2feae232-a97f-436e-855b-ef7a57a1e718 None None] Enqueued Resource ID: 0a63eb1f-74e9-474c-aca1-6d7eee3c02ad with Priority: HIGHEST for action port [ 742.476983] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a63eb1f-74e9-474c-aca1-6d7eee3c02ad with Priority: HIGHEST for action port [ 742.476983] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a63eb1f-74e9-474c-aca1-6d7eee3c02ad taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.476983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a63eb1f-74e9-474c-aca1-6d7eee3c02ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.476983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a63eb1f-74e9-474c-aca1-6d7eee3c02ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.476983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a63eb1f-74e9-474c-aca1-6d7eee3c02ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.476983] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a63eb1f-74e9-474c-aca1-6d7eee3c02ad',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.652053] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 in Status: SUCCESS [ 742.652591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.979786] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a63eb1f-74e9-474c-aca1-6d7eee3c02ad [ 742.980122] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.980251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.980306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.980547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.980644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.980758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a63eb1f-74e9-474c-aca1-6d7eee3c02ad already deleted. [ 742.980848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a63eb1f-74e9-474c-aca1-6d7eee3c02ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.107363] env[69728]: INFO networking_nsxv3.common.synchronization [req-0ddd0f8c-c0ac-4d9a-8c79-9d4b16194c8f req-19e8dfc0-6db0-4a2c-a362-7de4a9b29b21 tempest-ServersTestManualDisk-1834955542 tempest-ServersTestManualDisk-1834955542-project-member] Enqueued Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_members [ 744.107888] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_members [ 744.108283] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.108410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.108454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.109932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.110396] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.110396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.110396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.110641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.110743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.110855] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.615669] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.615817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.615880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.616115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.616213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.616405] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.616507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.616570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.616723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.616847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.616883] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 already deleted. [ 744.616947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.670123] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9e0c19fe-4588-421e-8842-3ccff2521f09 None None] Enqueued Resource ID: bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4 with Priority: HIGHEST for action port [ 744.670675] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4 with Priority: HIGHEST for action port [ 744.673050] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.673507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.673572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.673843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.673950] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.700016] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-178 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.700266] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-178" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.700464] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-178" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.700790] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-178" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.701118] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.701288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.701402] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.701621] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.701760] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.701966] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.702103] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.702191] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.702342] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.702461] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 744.702592] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.702758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.723628] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.723899] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 744.724136] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.724459] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-178" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.724892] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-bb192e9d-13b6-445d-93ba-01bd6a295050 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.725185] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.725397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.725836] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.726068] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb192e9d-13b6-445d-93ba-01bd6a295050',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.176221] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4 [ 745.177307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.177307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.177307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.177307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.177307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.177307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4 already deleted. [ 745.177623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbbac0ce-98b6-4383-b3f2-d00bf0fd5fb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.229356] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.229592] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.229720] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.230011] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.230174] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.230350] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port bb192e9d-13b6-445d-93ba-01bd6a295050 not found, creating... [ 745.230671] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.230837] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.230969] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.231300] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.231353] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.231622] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.231778] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.231893] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.232904] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.233082] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.233235] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: bb192e9d-13b6-445d-93ba-01bd6a295050 is going to be created. [ 745.252482] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.252696] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.252823] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.253167] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.253423] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.253669] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.511126] env[69728]: INFO networking_nsxv3.common.synchronization [req-6650f52a-cb0e-4031-a139-e889d006ef0e req-bbbdb978-9804-43b3-bc1a-e747c6f4c649 tempest-ServerDiagnosticsTest-7361437 tempest-ServerDiagnosticsTest-7361437-project-member] Enqueued Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_members [ 745.511736] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGHEST for action security_group_members [ 745.513696] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.513696] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.513696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.513696] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.023727] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.023727] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.023727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.023727] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc is going to be updated. [ 746.045685] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.047026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.047026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.047026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.047026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.055120] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc in Status: IN_PROGRESS for 2s [ 746.067917] env[69728]: INFO networking_nsxv3.common.synchronization [req-0ddd0f8c-c0ac-4d9a-8c79-9d4b16194c8f req-757790e5-c857-4591-aa3a-d5bc4c42f2b5 service nova] Enqueued Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_rules [ 746.067917] env[69728]: INFO networking_nsxv3.common.synchronization [req-0ddd0f8c-c0ac-4d9a-8c79-9d4b16194c8f req-757790e5-c857-4591-aa3a-d5bc4c42f2b5 service nova] Enqueued Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_members [ 746.067917] env[69728]: INFO networking_nsxv3.common.synchronization [req-0ddd0f8c-c0ac-4d9a-8c79-9d4b16194c8f req-757790e5-c857-4591-aa3a-d5bc4c42f2b5 service nova] Enqueued Resource ID: bb192e9d-13b6-445d-93ba-01bd6a295050 with Priority: HIGHEST for action port [ 746.067917] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_rules [ 746.067917] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_members [ 746.067917] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb192e9d-13b6-445d-93ba-01bd6a295050 with Priority: HIGHEST for action port [ 746.067917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.068528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.068698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.068971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.069211] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.070200] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.070486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.070674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.070909] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.071203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.073017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.073017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.073017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.073017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.073017] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.073017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb192e9d-13b6-445d-93ba-01bd6a295050 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.073017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.073017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.073759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.073946] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb192e9d-13b6-445d-93ba-01bd6a295050',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.575982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.575982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.576348] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.577713] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb192e9d-13b6-445d-93ba-01bd6a295050 with status ACTIVE [ 746.577713] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.577713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.577713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.578863] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.578863] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.578863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.579500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.580616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.580616] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb192e9d-13b6-445d-93ba-01bd6a295050 is going to be updated. [ 746.601178] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.601178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.601178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.601178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.601178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.601178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb192e9d-13b6-445d-93ba-01bd6a295050" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.082761] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.588518] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.588518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.588518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.588518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.588518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.588518] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 is going to be created. [ 747.612584] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.612993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.613248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.615150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.615150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.623827] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 in Status: UNINITIALIZED for 2s [ 748.068081] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc in Status: SUCCESS [ 748.068370] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc deletion is rescheduled due to dependency. [ 748.068798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.149741] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9958260f-7cc7-4b11-a09a-2b546aae4e30 None None] Enqueued Resource ID: f1ec8efa-4dae-4994-9d4f-ee47e4253c05 with Priority: HIGHEST for action port [ 749.150017] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ec8efa-4dae-4994-9d4f-ee47e4253c05 with Priority: HIGHEST for action port [ 749.151125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ec8efa-4dae-4994-9d4f-ee47e4253c05 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.151416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ec8efa-4dae-4994-9d4f-ee47e4253c05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.151531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ec8efa-4dae-4994-9d4f-ee47e4253c05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.151905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ec8efa-4dae-4994-9d4f-ee47e4253c05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.152027] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ec8efa-4dae-4994-9d4f-ee47e4253c05',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.179481] env[69728]: INFO networking_nsxv3.common.synchronization [req-89f82a47-697e-417f-935b-c73d73889695 req-8a99169f-b8c6-4e69-bdc1-c40e9a262251 tempest-InstanceActionsNegativeTestJSON-539763132 tempest-InstanceActionsNegativeTestJSON-539763132-project-member] Enqueued Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_members [ 749.180062] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 with Priority: HIGHEST for action security_group_members [ 749.180391] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.180546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.180713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.180819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.181953] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.182098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.182244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.182634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.183890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.183890] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b4ce391-586f-4e43-aae8-8f6f4baf13c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.581972] env[69728]: INFO networking_nsxv3.common.synchronization [req-d549fb72-76a7-43cc-8f6b-c16a226d9bc4 req-9c22bab0-35e4-4626-a98e-8b8854b0d1e6 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 749.582579] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 749.582914] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.583064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.583305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.583391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.583597] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.583662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.583722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.583877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.583965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.584085] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.636106] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 in Status: SUCCESS [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.636106] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.636106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.636106] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.655179] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1ec8efa-4dae-4994-9d4f-ee47e4253c05 [ 749.655380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.655569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.655679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.656008] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.656108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.656228] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1ec8efa-4dae-4994-9d4f-ee47e4253c05 already deleted. [ 749.656356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ec8efa-4dae-4994-9d4f-ee47e4253c05" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.686615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.686615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.686766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.686919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.687022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.687221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.687320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.687387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.687668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.687668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.687761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 is going to be updated. [ 749.719356] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.719356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.719356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.719356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.719356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.726544] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 in Status: IN_PROGRESS for 2s [ 750.086325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.086325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.086451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.086676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.086783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.087010] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.087124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.087191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.087361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.087439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.087527] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef already deleted. [ 750.087605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.139186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.528289] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.528289] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-991" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.528289] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-991" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.528816] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-991" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.529259] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.529644] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.529935] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.530280] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.530563] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.530891] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.531118] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.531341] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.531540] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.531742] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 750.531938] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.532173] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 750.553580] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 750.553580] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 750.553580] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 750.553580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-991" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.553580] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-52d4541c-a6f8-451f-bc69-246c209af27a taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.553580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.553580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.553580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.553580] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52d4541c-a6f8-451f-bc69-246c209af27a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.642753] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed04af6-5d88-4a9b-a4a4-60feb8636b45: rpc.has_security_group_logging(os_id): False [ 750.660662] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.660816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.660880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.661812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.661812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.661812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.661812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.661812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.661812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.661812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.662023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 is going to be created. [ 750.716222] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.717268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.717577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.718162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.718904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.732128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 in Status: IN_PROGRESS for 2s [ 751.055568] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.055789] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.055916] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.056224] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.056367] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.056528] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 52d4541c-a6f8-451f-bc69-246c209af27a not found, creating... [ 751.056769] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.056918] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.057068] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.057279] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.057411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.057723] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.057938] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.057982] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.059428] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.059689] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.060231] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 52d4541c-a6f8-451f-bc69-246c209af27a is going to be created. [ 751.078456] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.078518] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.078667] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.078899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.079257] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.079356] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.361591] env[69728]: INFO networking_nsxv3.common.synchronization [None req-40744802-449a-450a-aa1e-78af5e1d6371 None None] Enqueued Resource ID: d6ec002e-967e-473e-a72e-71cbe385d240 with Priority: HIGHEST for action port [ 751.362118] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6ec002e-967e-473e-a72e-71cbe385d240 with Priority: HIGHEST for action port [ 751.362698] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6ec002e-967e-473e-a72e-71cbe385d240 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.362698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6ec002e-967e-473e-a72e-71cbe385d240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.362698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6ec002e-967e-473e-a72e-71cbe385d240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.362857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6ec002e-967e-473e-a72e-71cbe385d240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.362932] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6ec002e-967e-473e-a72e-71cbe385d240',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.393219] env[69728]: INFO networking_nsxv3.common.synchronization [None req-9598819c-188f-4c4b-9ec8-9de0c42acbfd None None] Enqueued Resource ID: f93cc484-0bc1-46d6-a4ad-a799c7590bef with Priority: HIGHEST for action port [ 751.393967] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93cc484-0bc1-46d6-a4ad-a799c7590bef with Priority: HIGHEST for action port [ 751.394479] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f93cc484-0bc1-46d6-a4ad-a799c7590bef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.394600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f93cc484-0bc1-46d6-a4ad-a799c7590bef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.394672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f93cc484-0bc1-46d6-a4ad-a799c7590bef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.394977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f93cc484-0bc1-46d6-a4ad-a799c7590bef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.395051] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93cc484-0bc1-46d6-a4ad-a799c7590bef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.737373] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 in Status: SUCCESS [ 751.737904] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b4ce391-586f-4e43-aae8-8f6f4baf13c7 deletion is rescheduled due to dependency. [ 751.738191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b4ce391-586f-4e43-aae8-8f6f4baf13c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.865744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6ec002e-967e-473e-a72e-71cbe385d240 [ 751.865995] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.866170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.866250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.866473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.866564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.866657] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6ec002e-967e-473e-a72e-71cbe385d240 already deleted. [ 751.866739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6ec002e-967e-473e-a72e-71cbe385d240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.898397] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f93cc484-0bc1-46d6-a4ad-a799c7590bef [ 751.898624] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.898761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.898824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.899052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.899163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.899767] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f93cc484-0bc1-46d6-a4ad-a799c7590bef already deleted. [ 751.899767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f93cc484-0bc1-46d6-a4ad-a799c7590bef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.508252] env[69728]: INFO networking_nsxv3.common.synchronization [req-d549fb72-76a7-43cc-8f6b-c16a226d9bc4 req-d29ef4a7-b006-4e8d-a650-911697158e07 service nova] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 752.508252] env[69728]: INFO networking_nsxv3.common.synchronization [req-d549fb72-76a7-43cc-8f6b-c16a226d9bc4 req-d29ef4a7-b006-4e8d-a650-911697158e07 service nova] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 752.508252] env[69728]: INFO networking_nsxv3.common.synchronization [req-d549fb72-76a7-43cc-8f6b-c16a226d9bc4 req-d29ef4a7-b006-4e8d-a650-911697158e07 service nova] Enqueued Resource ID: 52d4541c-a6f8-451f-bc69-246c209af27a with Priority: HIGHEST for action port [ 752.508252] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 752.508252] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 752.508252] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4541c-a6f8-451f-bc69-246c209af27a with Priority: HIGHEST for action port [ 752.508562] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.508562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.508707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.508834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.508900] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.509940] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.510076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.510154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.510351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.510588] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.510691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.510754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.510926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.511041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.511185] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.512374] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-52d4541c-a6f8-451f-bc69-246c209af27a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.512452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.512517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.513918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.513918] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52d4541c-a6f8-451f-bc69-246c209af27a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.745023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 in Status: SUCCESS [ 752.745023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.849019] env[69728]: INFO networking_nsxv3.common.synchronization [req-81a0e424-b331-4b12-9c4a-3c6401e30796 req-ae4528db-12cc-475d-8a6d-994fc13b63dd tempest-ServersTestFqdnHostnames-1351333799 tempest-ServersTestFqdnHostnames-1351333799-project-member] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_members [ 752.849019] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_members [ 752.849019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.849019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.849019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.849019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.849019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.849019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.849019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.849821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.849821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.849821] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.015142] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.015142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.015253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.015661] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52d4541c-a6f8-451f-bc69-246c209af27a with status ACTIVE [ 753.015855] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.015935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.015990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.016252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.016338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.016527] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.016631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.016686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.017873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.017994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.018237] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.018340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.018406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.018580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.018657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.018743] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52d4541c-a6f8-451f-bc69-246c209af27a is going to be updated. [ 753.046657] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.046745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.048434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.048627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.048767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.048935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.304858] env[69728]: INFO networking_nsxv3.common.synchronization [req-9f63bf51-dd3e-4353-8e2a-ef4c2d2d002b req-bc461c71-d071-45e9-a662-f045feff04fc tempest-SecurityGroupRulesNegativeTestJSON-200486770 tempest-SecurityGroupRulesNegativeTestJSON-200486770-project-member] Enqueued Resource ID: 66a15311-4f4e-40aa-aad9-7dcd6ba50f4c with Priority: HIGHEST for action security_group_rules [ 753.306752] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a15311-4f4e-40aa-aad9-7dcd6ba50f4c with Priority: HIGHEST for action security_group_rules [ 753.306752] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.306752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.306752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.310750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.310750] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66a15311-4f4e-40aa-aad9-7dcd6ba50f4c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.353522] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.353711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.353768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.354119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.354119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.354490] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.354490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.354490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.354632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.354706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.355057] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 already deleted. [ 753.355057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.495267] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-799 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.495267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-799" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.495267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-799" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.495695] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-799" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.495695] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.495695] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.495863] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.496034] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.496189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.496399] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.496511] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.496620] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.496726] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.496829] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 753.496999] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.497164] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.515636] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.516697] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 753.516697] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.516697] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-799" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.516697] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f248f93d-a99f-4ac4-99f6-3366dee38f1b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.516980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.516980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.517319] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.517463] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f248f93d-a99f-4ac4-99f6-3366dee38f1b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.518328] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.649091] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e30ab781-1222-4fa8-bb2d-03c82ef6e754 None None] Enqueued Resource ID: 69ac3f13-7255-48ff-8516-107720b1adc8 with Priority: HIGHEST for action port [ 753.649091] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ac3f13-7255-48ff-8516-107720b1adc8 with Priority: HIGHEST for action port [ 753.649091] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-69ac3f13-7255-48ff-8516-107720b1adc8 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.649091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69ac3f13-7255-48ff-8516-107720b1adc8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.649091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69ac3f13-7255-48ff-8516-107720b1adc8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.649559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69ac3f13-7255-48ff-8516-107720b1adc8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.649694] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ac3f13-7255-48ff-8516-107720b1adc8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.831235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.832657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.832657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.832657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.832657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.832657] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66a15311-4f4e-40aa-aad9-7dcd6ba50f4c already deleted. [ 753.832657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.020922] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.021211] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.021598] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.021598] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.021871] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.021871] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f248f93d-a99f-4ac4-99f6-3366dee38f1b not found, creating... [ 754.022085] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.022734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.022734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.022734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.022734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.023172] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.023172] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.023251] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.023540] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.023595] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.023962] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f248f93d-a99f-4ac4-99f6-3366dee38f1b is going to be created. [ 754.025028] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.025028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.025185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.025218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.025334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.025364] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be created. [ 754.048866] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.049115] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.049272] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.049540] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.049768] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.051596] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.052167] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.052241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.056015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.056015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.056015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.060746] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: UNINITIALIZED for 2s [ 754.112323] env[69728]: INFO networking_nsxv3.common.synchronization [req-7a04ffd8-9db1-4218-bf2d-b5606662152d req-cdc0f7fd-650c-45d8-8fc8-123723333979 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 754.113221] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 754.113541] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.113672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.113731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.113933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.118296] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.118376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.118411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.118792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.118792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.118792] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.127360] env[69728]: INFO networking_nsxv3.common.synchronization [req-ea406443-6891-4e53-83cd-bf57ac7bb7fc req-dbae2cc2-e18f-4726-a823-d269d85153b1 tempest-SecurityGroupRulesNegativeTestJSON-200486770 tempest-SecurityGroupRulesNegativeTestJSON-200486770-project-member] Enqueued Resource ID: 66a15311-4f4e-40aa-aad9-7dcd6ba50f4c with Priority: HIGHEST for action security_group_rules [ 754.127845] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a15311-4f4e-40aa-aad9-7dcd6ba50f4c with Priority: HIGHEST for action security_group_rules [ 754.128204] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.128336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.128401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.128593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.128676] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66a15311-4f4e-40aa-aad9-7dcd6ba50f4c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.152590] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69ac3f13-7255-48ff-8516-107720b1adc8 [ 754.153164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.153164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.153164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.153345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.153891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.153891] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69ac3f13-7255-48ff-8516-107720b1adc8 already deleted. [ 754.153891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69ac3f13-7255-48ff-8516-107720b1adc8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.621719] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.621908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.621977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.622242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.622358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.622710] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.622834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.622902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.623094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.623179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.623269] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 754.650441] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.650724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.650724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.650926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.650966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.651078] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66a15311-4f4e-40aa-aad9-7dcd6ba50f4c already deleted. [ 754.651159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66a15311-4f4e-40aa-aad9-7dcd6ba50f4c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.656671] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.656803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.656870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.660174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.660174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.667701] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 755.016711] env[69728]: INFO networking_nsxv3.common.synchronization [req-81a0e424-b331-4b12-9c4a-3c6401e30796 req-5e13c960-43bb-4341-a4ac-70de5d23fde6 service nova] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_rules [ 755.016994] env[69728]: INFO networking_nsxv3.common.synchronization [req-81a0e424-b331-4b12-9c4a-3c6401e30796 req-5e13c960-43bb-4341-a4ac-70de5d23fde6 service nova] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_members [ 755.017058] env[69728]: INFO networking_nsxv3.common.synchronization [req-81a0e424-b331-4b12-9c4a-3c6401e30796 req-5e13c960-43bb-4341-a4ac-70de5d23fde6 service nova] Enqueued Resource ID: f248f93d-a99f-4ac4-99f6-3366dee38f1b with Priority: HIGHEST for action port [ 755.017672] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_rules [ 755.017825] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_members [ 755.017992] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f248f93d-a99f-4ac4-99f6-3366dee38f1b with Priority: HIGHEST for action port [ 755.018273] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.018415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.018484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.018869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.018976] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.020225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.020288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.020317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.020491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.020643] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.020741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.020805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.020950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.021048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.021139] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.021821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f248f93d-a99f-4ac4-99f6-3366dee38f1b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.021926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.021998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.024036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.024140] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f248f93d-a99f-4ac4-99f6-3366dee38f1b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.468958] env[69728]: INFO networking_nsxv3.common.synchronization [req-09c9aea5-5068-4e52-a9bd-516f5e639e95 req-197dd67a-34ad-4205-b198-c2b2e5eb8197 tempest-ServerMetadataTestJSON-1193914433 tempest-ServerMetadataTestJSON-1193914433-project-member] Enqueued Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_members [ 755.469429] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_members [ 755.469733] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.469854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.469922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.470239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.470328] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.470535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.470535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.471111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.471209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.471312] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.530094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f248f93d-a99f-4ac4-99f6-3366dee38f1b with status ACTIVE [ 755.530094] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.530094] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.530094] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.530094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.530094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f248f93d-a99f-4ac4-99f6-3366dee38f1b is going to be updated. [ 755.530913] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.535020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.535135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.561688] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.561823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.561878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.562108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.562237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.562418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f248f93d-a99f-4ac4-99f6-3366dee38f1b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.973893] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.974121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.974250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.974533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.974672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.974929] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.975106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.975189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.975358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.975440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.975527] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 already deleted. [ 755.975607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.035682] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.070040] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 756.070267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.070419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.070641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.070830] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.070944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.070999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.071172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.071257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.071418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.071471] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.538344] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.538529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.538611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.538821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.538913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.539122] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 is going to be created. [ 756.564642] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.564825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.564940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.565116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.565300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.580983] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339553a7-1e43-4dfd-9442-5889c248b938 in Status: UNINITIALIZED for 2s [ 756.581243] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.677866] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 756.678073] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 756.678240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.779224] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-559 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.779628] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-559" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.779979] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-559" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.780381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-559" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.780682] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.780866] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.780997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.781249] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.781399] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.781628] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 756.781743] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 756.781856] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 756.781982] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 756.782116] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 756.782223] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 756.782357] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 756.800388] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 756.800589] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 756.800751] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 756.800948] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-559" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.801294] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-47ee5d81-a552-4a01-8e6d-787be159e508 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.801474] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.801607] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.801942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.802109] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ee5d81-a552-4a01-8e6d-787be159e508',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.083785] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c4b88c-3e7a-48c7-84e2-371c7b5dffef: rpc.has_security_group_logging(os_id): False [ 757.101876] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.102875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.102875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.102875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.102875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.102875] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.103164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.103164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.103557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.103647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.103739] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be created. [ 757.171235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.171235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.171235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.171235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.171235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.194102] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 757.307432] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.307432] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 47ee5d81-a552-4a01-8e6d-787be159e508 not found, creating... [ 757.307432] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.307432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.308689] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.309172] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.309530] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.309828] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.310338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.310611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.310890] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 47ee5d81-a552-4a01-8e6d-787be159e508 is going to be created. [ 757.331299] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.331474] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.331549] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.331829] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.332061] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.332343] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.596358] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339553a7-1e43-4dfd-9442-5889c248b938 in Status: SUCCESS [ 758.596661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.596885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.597188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.597465] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.597630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.597726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.597943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.598076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.598212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.598345] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.667823] env[69728]: INFO networking_nsxv3.common.synchronization [req-51c0a9d7-e771-465b-a568-78d2415d91b9 req-fbde3ae5-8c64-4035-a1a5-40089808ae4e tempest-VolumesAdminNegativeTest-8298396 tempest-VolumesAdminNegativeTest-8298396-project-member] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_members [ 758.668388] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_members [ 758.668694] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.668820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.668889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.669314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.669475] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.669543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.669594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.669755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.669845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.669938] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.770648] env[69728]: INFO networking_nsxv3.common.synchronization [req-09c9aea5-5068-4e52-a9bd-516f5e639e95 req-2f02b2f6-e110-4874-80c6-a35ac879e5cc service nova] Enqueued Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_rules [ 758.770898] env[69728]: INFO networking_nsxv3.common.synchronization [req-09c9aea5-5068-4e52-a9bd-516f5e639e95 req-2f02b2f6-e110-4874-80c6-a35ac879e5cc service nova] Enqueued Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_members [ 758.771065] env[69728]: INFO networking_nsxv3.common.synchronization [req-09c9aea5-5068-4e52-a9bd-516f5e639e95 req-2f02b2f6-e110-4874-80c6-a35ac879e5cc service nova] Enqueued Resource ID: 47ee5d81-a552-4a01-8e6d-787be159e508 with Priority: HIGHEST for action port [ 758.771592] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_rules [ 758.771743] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_members [ 758.771826] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47ee5d81-a552-4a01-8e6d-787be159e508 with Priority: HIGHEST for action port [ 758.772217] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.772353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.772421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.772671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.772755] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.773630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.773744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.773811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.774020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.774125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.774221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.774289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.774437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.774521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.774608] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.781234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-47ee5d81-a552-4a01-8e6d-787be159e508 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.781234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.781234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.781234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.781234] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47ee5d81-a552-4a01-8e6d-787be159e508',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.101020] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.172180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.172337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.172410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.172625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.172718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.172919] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.173030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.173090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.173244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.173322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.173406] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf already deleted. [ 759.173487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.210189] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 759.210420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.284019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.284019] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47ee5d81-a552-4a01-8e6d-787be159e508 with status ACTIVE [ 759.284019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.284019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.284493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.284493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284493] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.284493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.284656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.284683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.284870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284870] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47ee5d81-a552-4a01-8e6d-787be159e508 is going to be updated. [ 759.307064] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.307257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.307338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.307568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.307753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.308732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47ee5d81-a552-4a01-8e6d-787be159e508" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.531534] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-642 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.531766] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.531848] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.532213] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.532473] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.532626] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.532746] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.533499] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.533661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.533861] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.533979] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.534106] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.534289] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.534344] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.534426] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.534537] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.554469] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.554712] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.554863] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.555127] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.555540] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-655c5bc2-1764-483b-bbf4-2229997d80d6 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.555790] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.556087] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.556320] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.556480] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('655c5bc2-1764-483b-bbf4-2229997d80d6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.603320] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 339553a7-1e43-4dfd-9442-5889c248b938: rpc.has_security_group_logging(os_id): False [ 759.622584] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.622584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.691386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.691386] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 is going to be created. [ 759.691386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.691386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.697227] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 339553a7-1e43-4dfd-9442-5889c248b938 in Status: IN_PROGRESS for 2s [ 759.787887] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.059643] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.060255] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.060255] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.060489] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.060596] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.060725] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 655c5bc2-1764-483b-bbf4-2229997d80d6 not found, creating... [ 760.062650] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.062650] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.062650] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.062650] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.062650] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.064925] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.065115] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.065242] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.065451] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.066252] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.066252] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 655c5bc2-1764-483b-bbf4-2229997d80d6 is going to be created. [ 760.085959] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.086332] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.086481] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.086751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.086975] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.087215] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.291909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.292095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.292169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.292384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.292475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.292577] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 is going to be created. [ 760.319980] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.320148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.320215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.320428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.320589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.331084] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 in Status: UNINITIALIZED for 2s [ 761.720471] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 339553a7-1e43-4dfd-9442-5889c248b938 in Status: SUCCESS [ 761.720877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.866785] env[69728]: INFO networking_nsxv3.common.synchronization [req-51c0a9d7-e771-465b-a568-78d2415d91b9 req-55dedef8-bbf0-4f3a-9084-645834228c52 service nova] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_rules [ 761.868786] env[69728]: INFO networking_nsxv3.common.synchronization [req-51c0a9d7-e771-465b-a568-78d2415d91b9 req-55dedef8-bbf0-4f3a-9084-645834228c52 service nova] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_members [ 761.868786] env[69728]: INFO networking_nsxv3.common.synchronization [req-51c0a9d7-e771-465b-a568-78d2415d91b9 req-55dedef8-bbf0-4f3a-9084-645834228c52 service nova] Enqueued Resource ID: 655c5bc2-1764-483b-bbf4-2229997d80d6 with Priority: HIGHEST for action port [ 761.868786] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_rules [ 761.868786] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_members [ 761.868786] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 655c5bc2-1764-483b-bbf4-2229997d80d6 with Priority: HIGHEST for action port [ 761.868786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.868786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.868786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.868786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.868786] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.873014] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.873014] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.873014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.873014] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-655c5bc2-1764-483b-bbf4-2229997d80d6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.873014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.873014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('655c5bc2-1764-483b-bbf4-2229997d80d6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.340757] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 in Status: SUCCESS [ 762.341008] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.341186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.341401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.341892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.341892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.341892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.341892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.342118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.342118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.342179] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.378213] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.379234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.379347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.379500] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 655c5bc2-1764-483b-bbf4-2229997d80d6 with status ACTIVE [ 762.379615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.379721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.379787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.380285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.380285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.380285] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.380471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.380471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.381895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.381895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.381895] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.381895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.381895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.383834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.383834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.383834] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 655c5bc2-1764-483b-bbf4-2229997d80d6 is going to be updated. [ 762.402678] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.402814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.402882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.403248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.403248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.403401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-655c5bc2-1764-483b-bbf4-2229997d80d6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.844712] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.844989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.844989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.845180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.845338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.845439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.845503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.845654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.845743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.845878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.845969] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.846075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.846137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.846305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.846511] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.846554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.846584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.846761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.846869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.846976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.847086] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.885020] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.351744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e9aa9c6-847d-4842-a489-0d7e99a2f946: rpc.has_security_group_logging(os_id): False [ 763.368265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.368483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.368555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.370017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.370453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.370453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.370555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.370585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370892] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 is going to be created. [ 763.387673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.387865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.387936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.388168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.388257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.388405] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf is going to be created. [ 763.420106] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.420106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.421541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.421541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.421541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.433387] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: UNINITIALIZED for 2s [ 763.440073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.440220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.440288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.441276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.441276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.455536] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 in Status: IN_PROGRESS for 2s [ 765.445834] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: SUCCESS [ 765.446171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.446451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.446695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.447985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.448169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.448243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.448427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.448535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.448637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.448732] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.466746] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 in Status: SUCCESS [ 765.466746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.951597] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.455750] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4195a4b3-a062-447e-88f8-e19488536bcf: rpc.has_security_group_logging(os_id): False [ 766.476695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.476854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.476916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.477149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.477249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.477506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.477616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.477666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.478024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.478024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.478024] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf is going to be created. [ 766.572599] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.572599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.572599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.572599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.572599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.586095] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: IN_PROGRESS for 2s [ 766.868936] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 766.869094] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 768.267540] env[69728]: INFO networking_nsxv3.common.synchronization [req-85b7149e-2edb-4260-9cee-cae2d6629493 req-c43e8fd2-2c71-4eb5-abd3-d9b4be01a713 tempest-FloatingIPsAssociationTestJSON-1968110794 tempest-FloatingIPsAssociationTestJSON-1968110794-project-member] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 768.268109] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 768.268451] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.270116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.271507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.271507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.271507] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.271507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.271507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.271507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.271507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.271507] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.598214] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: SUCCESS [ 768.598663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.774325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.774542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.774542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.774771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.774855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.775068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.775210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.775290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.775391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.775470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.775548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 already deleted. [ 768.775617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.877070] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-195 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.877280] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.877409] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.877737] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.878014] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.878639] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.878762] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.879648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.879648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.879648] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.879648] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.879648] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.879906] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.879906] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 768.879961] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.880093] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.899732] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.899907] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 768.900058] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.900293] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.904025] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.904025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.904025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.904025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.904025] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.946375] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3328467a-0d0f-4531-afb7-ff2ee0bd47c7 None None] Enqueued Resource ID: e04dd383-8ea3-452a-8168-173c45cb207d with Priority: HIGHEST for action port [ 768.946668] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04dd383-8ea3-452a-8168-173c45cb207d with Priority: HIGHEST for action port [ 768.947251] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e04dd383-8ea3-452a-8168-173c45cb207d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.947396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e04dd383-8ea3-452a-8168-173c45cb207d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.947442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e04dd383-8ea3-452a-8168-173c45cb207d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.947693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e04dd383-8ea3-452a-8168-173c45cb207d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.947775] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04dd383-8ea3-452a-8168-173c45cb207d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.407197] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.407466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.407601] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.407874] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.408223] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.408223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb not found, creating... [ 769.408786] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.408960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.409097] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.409879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.409879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.409879] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.410142] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.410375] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.410872] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.410872] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.410872] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb is going to be created. [ 769.433938] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.434307] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.434703] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.434940] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.435415] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.435878] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.451637] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e04dd383-8ea3-452a-8168-173c45cb207d [ 769.451870] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.452014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.452090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.452309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.452404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.452499] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e04dd383-8ea3-452a-8168-173c45cb207d already deleted. [ 769.453588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e04dd383-8ea3-452a-8168-173c45cb207d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.355871] env[69728]: INFO networking_nsxv3.common.synchronization [req-85b7149e-2edb-4260-9cee-cae2d6629493 req-afd1556f-0cc8-46b2-ba3f-d1c10284b0f5 service nova] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_rules [ 770.356018] env[69728]: INFO networking_nsxv3.common.synchronization [req-85b7149e-2edb-4260-9cee-cae2d6629493 req-afd1556f-0cc8-46b2-ba3f-d1c10284b0f5 service nova] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 770.356168] env[69728]: INFO networking_nsxv3.common.synchronization [req-85b7149e-2edb-4260-9cee-cae2d6629493 req-afd1556f-0cc8-46b2-ba3f-d1c10284b0f5 service nova] Enqueued Resource ID: 50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb with Priority: HIGHEST for action port [ 770.356461] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_rules [ 770.356534] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 770.356655] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb with Priority: HIGHEST for action port [ 770.357187] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.357316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.357379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.357632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.357715] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.358912] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.359043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.359116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.359300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.359590] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.359590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.360460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.360460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.360460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.360460] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.361301] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.361301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.361301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.361301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.361301] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.866021] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.866021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.866021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb with status ACTIVE [ 770.866021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.866021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.866021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.866798] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.866798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.866798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.871044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.871044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.871044] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb is going to be updated. [ 770.891700] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.891700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.891700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.891700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.891700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.891700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50fd10ef-e5fd-4222-bae7-14ea5e0ec6cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.371831] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.790407] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6294af67-adf2-4c67-a9e9-c355f229c5c6 None None] Enqueued Resource ID: 98ab7ecb-fd86-4ba0-bc98-100593839a80 with Priority: HIGHEST for action port [ 771.792478] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ab7ecb-fd86-4ba0-bc98-100593839a80 with Priority: HIGHEST for action port [ 771.792478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-98ab7ecb-fd86-4ba0-bc98-100593839a80 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.792478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98ab7ecb-fd86-4ba0-bc98-100593839a80" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.792478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98ab7ecb-fd86-4ba0-bc98-100593839a80" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.792478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98ab7ecb-fd86-4ba0-bc98-100593839a80" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.792478] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98ab7ecb-fd86-4ba0-bc98-100593839a80',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.876864] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.876864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.876864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.876864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.876864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.876864] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be created. [ 771.898445] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.901178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.901178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.901178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.901178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.914451] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: UNINITIALIZED for 2s [ 772.294742] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98ab7ecb-fd86-4ba0-bc98-100593839a80 [ 772.295051] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.295237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.295306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.295565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.295677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.295812] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98ab7ecb-fd86-4ba0-bc98-100593839a80 already deleted. [ 772.296017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98ab7ecb-fd86-4ba0-bc98-100593839a80" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.099129] env[69728]: INFO networking_nsxv3.common.synchronization [req-f172e701-abed-4cbb-be63-d6e8562ddf07 req-6adb0403-f70f-4c46-959a-c8db001485cd tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 773.099129] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 773.099129] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.099129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.099900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.100331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.100632] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.100885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.101097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.103683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.103683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.103683] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.607622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.607622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.607622] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd already deleted. [ 773.607622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.893426] env[69728]: INFO networking_nsxv3.common.synchronization [req-c9da2466-8477-4e19-b72c-8d1b4b036c21 req-de3c2db8-1e06-4311-93d3-380eb483788f tempest-ServerMetadataTestJSON-1193914433 tempest-ServerMetadataTestJSON-1193914433-project-member] Enqueued Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_members [ 773.893996] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGHEST for action security_group_members [ 773.894316] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.894433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.894500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.894705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.894853] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.894956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.895625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.895871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.896064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.896231] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.928489] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 773.928754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.929511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.929747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.929936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.930064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.930130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.930340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.930465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.934303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.934303] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.051744] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.051963] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.052070] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.052396] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.052717] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.052896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.053042] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.053275] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.053488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.054037] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.054037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.054037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.054190] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.054190] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 774.054289] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.054427] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.074329] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.074487] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 774.074619] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.074790] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.075147] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-888465b5-94d2-4988-9858-9698c61e3ba3 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.075314] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.076033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.076033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.076033] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('888465b5-94d2-4988-9858-9698c61e3ba3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.402825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.402825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.402825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.402825] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 is going to be updated. [ 774.428397] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.428650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.428962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.429533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.430190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.435063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.435622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.435795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.436076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.436299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.436454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.436559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.436767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.436988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.436988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.437214] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.437369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.437468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.437658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.437860] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.437986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.438099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.438281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.438576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.438720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.438860] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.440904] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 in Status: IN_PROGRESS for 2s [ 774.578478] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.579014] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.579174] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.579528] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.579745] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.579901] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 888465b5-94d2-4988-9858-9698c61e3ba3 not found, creating... [ 774.580205] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.580374] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.580493] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.580723] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.580866] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.581253] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.582026] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.582026] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.582026] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.582026] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.582026] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 888465b5-94d2-4988-9858-9698c61e3ba3 is going to be created. [ 774.601089] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.601385] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.601550] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.601910] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.602207] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.602885] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.875523] env[69728]: INFO networking_nsxv3.common.synchronization [None req-55883d2b-7eaf-4aa9-bd64-5bf27152d169 None None] Enqueued Resource ID: 5c5a97bc-c07c-43ac-8be1-508ff0627455 with Priority: HIGHEST for action port [ 774.875795] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5a97bc-c07c-43ac-8be1-508ff0627455 with Priority: HIGHEST for action port [ 774.876394] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c5a97bc-c07c-43ac-8be1-508ff0627455 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.876540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c5a97bc-c07c-43ac-8be1-508ff0627455" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.876584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c5a97bc-c07c-43ac-8be1-508ff0627455" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.876840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c5a97bc-c07c-43ac-8be1-508ff0627455" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.876927] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c5a97bc-c07c-43ac-8be1-508ff0627455',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.943065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd5fc210-b40b-42fd-9bcf-e190a117ea03: rpc.has_security_group_logging(os_id): False [ 774.960104] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.960231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.960231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.960405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.960497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.960689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.960953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.960953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.961085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.961085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.961845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.961845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.961845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.961845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.961845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.962115] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.962266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.962266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.962459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.962561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.962763] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be created. [ 775.022598] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.022836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.022893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.023118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.023326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.033711] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: IN_PROGRESS for 2s [ 775.381147] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c5a97bc-c07c-43ac-8be1-508ff0627455 [ 775.381399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.381573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.381637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.381846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.381940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.385813] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c5a97bc-c07c-43ac-8be1-508ff0627455 already deleted. [ 775.385994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c5a97bc-c07c-43ac-8be1-508ff0627455" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.465537] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b7b0f76a-6d14-4ac6-8110-6ca0073d96eb tempest-ServersV294TestFqdnHostnames-1182635706 tempest-ServersV294TestFqdnHostnames-1182635706-project-member] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_rules [ 775.465756] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_rules [ 775.465933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.466045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.466111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.466426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.466520] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.546567] env[69728]: INFO networking_nsxv3.common.synchronization [None req-d288d0c6-f2eb-490d-ad26-3dfce50292bd tempest-ServersV294TestFqdnHostnames-1182635706 tempest-ServersV294TestFqdnHostnames-1182635706-project-member] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_rules [ 775.547786] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_rules [ 775.548495] env[69728]: INFO networking_nsxv3.common.synchronization [req-f172e701-abed-4cbb-be63-d6e8562ddf07 req-348a16e9-46ca-4b7c-8b93-5d23272ceaeb service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 775.548678] env[69728]: INFO networking_nsxv3.common.synchronization [req-f172e701-abed-4cbb-be63-d6e8562ddf07 req-348a16e9-46ca-4b7c-8b93-5d23272ceaeb service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 775.548819] env[69728]: INFO networking_nsxv3.common.synchronization [req-f172e701-abed-4cbb-be63-d6e8562ddf07 req-348a16e9-46ca-4b7c-8b93-5d23272ceaeb service nova] Enqueued Resource ID: 888465b5-94d2-4988-9858-9698c61e3ba3 with Priority: HIGHEST for action port [ 775.549124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.549275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.549616] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 775.549735] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 775.549832] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 888465b5-94d2-4988-9858-9698c61e3ba3 with Priority: HIGHEST for action port [ 775.550310] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.550400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.550469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.550706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.550868] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.551942] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.552063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.552120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.552258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.552408] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.552504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.552841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.552841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.552841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.553016] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.553651] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-888465b5-94d2-4988-9858-9698c61e3ba3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.553794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.553828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.555478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.555478] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('888465b5-94d2-4988-9858-9698c61e3ba3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.909109] env[69728]: INFO networking_nsxv3.common.synchronization [req-ac842fc1-4b7d-4538-b930-b18b7d6b49a5 req-29f642cf-8499-4eda-b1d7-3408d3826521 tempest-ServersAdminNegativeTestJSON-1903866848 tempest-ServersAdminNegativeTestJSON-1903866848-project-member] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 775.909714] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 775.912017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.912017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.912017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.912017] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.991752] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.991907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.991992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.992230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.992306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.992482] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 already deleted. [ 775.992482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.993389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.993389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.993539] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.055769] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.062023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.062023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 888465b5-94d2-4988-9858-9698c61e3ba3 with status ACTIVE [ 776.062023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.062023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.062023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.062023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.063572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.063572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.063572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.063572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.063572] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 888465b5-94d2-4988-9858-9698c61e3ba3 is going to be updated. [ 776.082440] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.082440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.082440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.082598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.082767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.083067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-888465b5-94d2-4988-9858-9698c61e3ba3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.415415] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.450402] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 in Status: SUCCESS [ 776.451147] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 deletion is rescheduled due to dependency. [ 776.451290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.507261] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.507573] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.507740] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.508141] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.508479] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.508661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.508869] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.509215] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.509408] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.509735] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.509884] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.510038] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.510158] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.510342] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.510552] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.510743] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.516109] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.516109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.516109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.516109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.516272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.516272] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 already deleted. [ 776.516337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.533455] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.533625] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.533764] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.533935] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.534264] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.534433] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.534554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.534931] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.535029] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.558390] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.919042] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.041022] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.041022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 not found, creating... [ 777.041022] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.041022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.041519] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.041519] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.041519] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.041519] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.042126] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.042386] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 is going to be created. [ 777.045269] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 777.045269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.063021] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.063021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.063021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.063021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.063021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.063021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.063754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.064541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.067152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.067152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.067152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.067152] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be created. [ 777.096965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.096965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.096965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.096965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.096965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.109255] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: UNINITIALIZED for 2s [ 777.421347] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.421508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.421570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.421788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.421882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.421984] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be updated. [ 777.451028] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.451028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.451028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.451028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.451028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.457447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: IN_PROGRESS for 2s [ 777.818019] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3c1cedf1-ea71-4655-8111-49b3be13d5ca None None] Enqueued Resource ID: e11168cf-e577-43f3-b86b-016d537e641f with Priority: HIGHEST for action port [ 777.818019] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e11168cf-e577-43f3-b86b-016d537e641f with Priority: HIGHEST for action port [ 777.818019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e11168cf-e577-43f3-b86b-016d537e641f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.818019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e11168cf-e577-43f3-b86b-016d537e641f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.818019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e11168cf-e577-43f3-b86b-016d537e641f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.818019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e11168cf-e577-43f3-b86b-016d537e641f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.818019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e11168cf-e577-43f3-b86b-016d537e641f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.019563] env[69728]: INFO networking_nsxv3.common.synchronization [req-ac842fc1-4b7d-4538-b930-b18b7d6b49a5 req-be07efd3-9435-4016-8e10-6808e0e894a4 service nova] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_rules [ 778.019563] env[69728]: INFO networking_nsxv3.common.synchronization [req-ac842fc1-4b7d-4538-b930-b18b7d6b49a5 req-be07efd3-9435-4016-8e10-6808e0e894a4 service nova] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 778.019563] env[69728]: INFO networking_nsxv3.common.synchronization [req-ac842fc1-4b7d-4538-b930-b18b7d6b49a5 req-be07efd3-9435-4016-8e10-6808e0e894a4 service nova] Enqueued Resource ID: 9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 with Priority: HIGHEST for action port [ 778.019563] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_rules [ 778.019563] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 778.019563] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 with Priority: HIGHEST for action port [ 778.019563] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.020016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.020016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.020016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.020016] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.020906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.021050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.021280] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.021397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.021486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.021705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.021795] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.322376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e11168cf-e577-43f3-b86b-016d537e641f [ 778.322545] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.322701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.322778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.323018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.323122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.323232] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e11168cf-e577-43f3-b86b-016d537e641f already deleted. [ 778.323311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e11168cf-e577-43f3-b86b-016d537e641f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.523230] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.523370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.527356] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 with status ACTIVE [ 778.527637] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.527749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.527945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.528019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.528110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.528287] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.528415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.528489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.528733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.528733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.528861] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.529046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.529046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.529185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.529281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.529281] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035 is going to be updated. [ 778.549776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.549776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.549776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.549776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e15a8b6-c8f0-43b2-8d35-a1b0e78ec035" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.120468] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: UNINITIALIZED for 4s [ 779.135851] env[69728]: INFO networking_nsxv3.common.synchronization [req-c5748d46-71f6-4863-9857-1997720bc29d req-55da3212-75dc-4440-9b4b-c5039669f9a6 tempest-DeleteServersAdminTestJSON-668290985 tempest-DeleteServersAdminTestJSON-668290985-project-member] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 779.136397] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 779.136752] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.136912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.136960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.137167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.137315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.137415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.137477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.137629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.137717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.137814] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.466184] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 779.466403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.466599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.466819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.467013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.467132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.467196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.467347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.467430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.467531] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.640211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.640359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.640453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.640642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.640736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.640932] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.641041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.641103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.641254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.641333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.641418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be updated. [ 779.665565] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.665713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.665786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.665989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.666156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.674143] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: IN_PROGRESS for 2s [ 779.871732] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.871946] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.872087] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.872351] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.872757] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.872821] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.873037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.873247] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.873581] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.873581] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.873725] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.873839] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.873959] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.874098] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.874208] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.874401] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.891948] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.892126] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.892290] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.892474] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.892825] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f235b0ea-bfdf-494a-84b7-f12effb36aa2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.893026] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.893152] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.893482] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.893623] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f235b0ea-bfdf-494a-84b7-f12effb36aa2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.970880] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.395844] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.396189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.396189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.396366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.396484] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.396704] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f235b0ea-bfdf-494a-84b7-f12effb36aa2 not found, creating... [ 780.397036] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.397176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.397294] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.397520] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.397666] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.397971] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.398142] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.398259] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.398470] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.398629] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.398772] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f235b0ea-bfdf-494a-84b7-f12effb36aa2 is going to be created. [ 780.416967] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.417216] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.417351] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.417651] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.417909] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.418151] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.474298] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.981307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.981307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.981307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.981307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.981307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.981307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be updated. [ 781.010751] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.010751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.010751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.010751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.010751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.020447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: IN_PROGRESS for 2s [ 781.129322] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 781.129574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.129765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.129984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.130193] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.130312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.130380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.130541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.130625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.130711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.130804] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.319740] env[69728]: INFO networking_nsxv3.common.synchronization [req-c5748d46-71f6-4863-9857-1997720bc29d req-6d9795a9-27cd-4859-93fd-72d560d040bf service nova] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_rules [ 781.319965] env[69728]: INFO networking_nsxv3.common.synchronization [req-c5748d46-71f6-4863-9857-1997720bc29d req-6d9795a9-27cd-4859-93fd-72d560d040bf service nova] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 781.320129] env[69728]: INFO networking_nsxv3.common.synchronization [req-c5748d46-71f6-4863-9857-1997720bc29d req-6d9795a9-27cd-4859-93fd-72d560d040bf service nova] Enqueued Resource ID: f235b0ea-bfdf-494a-84b7-f12effb36aa2 with Priority: HIGHEST for action port [ 781.320366] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_rules [ 781.320500] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 781.320597] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f235b0ea-bfdf-494a-84b7-f12effb36aa2 with Priority: HIGHEST for action port [ 781.322815] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.322981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.323086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.323319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.323368] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.324353] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.324467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.324646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f235b0ea-bfdf-494a-84b7-f12effb36aa2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.324749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.324805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.324989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.325100] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f235b0ea-bfdf-494a-84b7-f12effb36aa2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.634747] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.635062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.635062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.635212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.635377] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.635489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.635522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.635668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.635895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.635895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.636060] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.636193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.636252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.636401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.636554] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.636638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.636717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.636854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.637187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.637187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.637187] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.683732] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 781.684045] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f deletion is rescheduled due to dependency. [ 781.684045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.684368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.684415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.684559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.684687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.684734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.684918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.685042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.685102] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.827358] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.827624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.827819] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f235b0ea-bfdf-494a-84b7-f12effb36aa2 with status ACTIVE [ 781.827993] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.828117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.828225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.828429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.828515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.828711] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.828822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.828881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.829048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.829127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.829318] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.829407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.829465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.829655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.829739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.829823] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f235b0ea-bfdf-494a-84b7-f12effb36aa2 is going to be updated. [ 781.850241] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.850241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.850241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.850241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.850241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.850241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f235b0ea-bfdf-494a-84b7-f12effb36aa2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.139392] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4864eea1-2a57-4824-a279-fb7f17aef5fd: rpc.has_security_group_logging(os_id): False [ 782.156852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.157025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.157122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.157350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.157467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.159011] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.159172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.159638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.159638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.160192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.161026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.161026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.161026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.161026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.161026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.161026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.161377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.161377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.161377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.161377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.161544] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be created. [ 782.187185] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.225978] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.226114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.227864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.227864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.227864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.236651] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 782.691069] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.032083] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 783.032383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.032492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.032706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.032902] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.033038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.033110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.033243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.033313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.033399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.033490] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.192810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.192923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.194030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.194030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.194030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.194030] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be updated. [ 783.220043] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.220179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.220233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.220435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.220574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.228783] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: IN_PROGRESS for 2s [ 783.504929] env[69728]: INFO networking_nsxv3.common.synchronization [req-f3827544-2ba0-4c3e-b374-348e0af7c112 req-28408619-9c5f-4834-9959-810f3e7f7986 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 783.505778] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 783.505778] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.505910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.505941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.506515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.506515] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.506679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.507225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.507440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.507570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.507945] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.535909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.536025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.536141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.536376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.536639] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.536780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.536936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.537146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.538416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.538634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.538840] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.538976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.539116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.539278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.539457] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.539614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.539704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.540705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.540829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.540946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.541077] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.013027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.013027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.013027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.013027] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf already deleted. [ 784.013691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.043022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca8a02e9-47d1-471b-858b-1d6a0bebf739: rpc.has_security_group_logging(os_id): False [ 784.060385] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.060385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.060385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.060562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.060562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.060749] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.060846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.060924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.061812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.061812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.061812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.061812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.061812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.061812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.061812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.062076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.062076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.062076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.062170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.062232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.062314] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be updated. [ 784.097628] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.097822] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.097943] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.098278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.098539] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.098786] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.098929] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.099819] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.099982] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.100219] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.100335] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 784.100536] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 784.100864] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 784.101021] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 784.101138] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 784.101365] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 784.121078] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 784.121240] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 784.121372] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 784.121545] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.121854] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f483a55d-c270-4325-acc0-bf433c8a4b25 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.122030] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.122149] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.122444] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.122574] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f483a55d-c270-4325-acc0-bf433c8a4b25',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.126049] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.126190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.126259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.126429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.126582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.140133] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: IN_PROGRESS for 2s [ 784.253104] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 784.253104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.629607] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.630213] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.630442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.630806] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.630999] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.631258] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f483a55d-c270-4325-acc0-bf433c8a4b25 not found, creating... [ 784.631647] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.631906] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.632334] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.632813] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.632876] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.633254] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.633520] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.633719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.634030] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.634282] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.635030] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f483a55d-c270-4325-acc0-bf433c8a4b25 is going to be created. [ 784.654086] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.654805] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.655068] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.655973] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.656183] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.656531] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.238509] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 785.239138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.239472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.239700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.239933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.240295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.240369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.240536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.240639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.241050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.241050] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.633529] env[69728]: INFO networking_nsxv3.common.synchronization [req-f3827544-2ba0-4c3e-b374-348e0af7c112 req-42188f53-d44a-4498-86d1-498064d94db2 service nova] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 785.633715] env[69728]: INFO networking_nsxv3.common.synchronization [req-f3827544-2ba0-4c3e-b374-348e0af7c112 req-42188f53-d44a-4498-86d1-498064d94db2 service nova] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 785.633889] env[69728]: INFO networking_nsxv3.common.synchronization [req-f3827544-2ba0-4c3e-b374-348e0af7c112 req-42188f53-d44a-4498-86d1-498064d94db2 service nova] Enqueued Resource ID: f483a55d-c270-4325-acc0-bf433c8a4b25 with Priority: HIGHEST for action port [ 785.634177] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 785.634318] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 785.634419] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f483a55d-c270-4325-acc0-bf433c8a4b25 with Priority: HIGHEST for action port [ 785.639656] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.639656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.639656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.639656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.639656] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.641677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.641866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.641954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.642407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.642588] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.642688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.642783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.643019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.643113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.643264] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.644976] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f483a55d-c270-4325-acc0-bf433c8a4b25 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.645127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.645198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.645389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.645468] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f483a55d-c270-4325-acc0-bf433c8a4b25',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.748304] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.748304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.748304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.748304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.748304] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.748304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.748304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.748304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.748704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.748704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.748704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.748704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.748829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.748858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.748993] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.749091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.750098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.750098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.750098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.750098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.750098] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.148186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.149029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.149029] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.150070] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f483a55d-c270-4325-acc0-bf433c8a4b25 with status ACTIVE [ 786.150317] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.150490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.150577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.150850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.150994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.151287] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.152012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.152740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.152740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.152740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.152740] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.153019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.153019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.153125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.153125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.153238] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f483a55d-c270-4325-acc0-bf433c8a4b25 is going to be updated. [ 786.155123] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 786.155314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.175075] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.175294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.175528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.176160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.176282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.176533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f483a55d-c270-4325-acc0-bf433c8a4b25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.252248] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e88d88-3454-4e14-8364-c48e1d31646f: rpc.has_security_group_logging(os_id): False [ 786.270054] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.270209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.270209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.270472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.270588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.270811] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.270966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.270998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.271259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.271372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.271629] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.271746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.271868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.272017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.272147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.272362] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.272543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.272630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.272844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.272912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.273009] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be updated. [ 786.337298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.337455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.337528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.337732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.337875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.353598] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: IN_PROGRESS for 2s [ 786.656436] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.158681] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.158923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.158923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.162252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.162359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.162548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be created. [ 787.186699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.186699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.186699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.187199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.187533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.199134] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: UNINITIALIZED for 2s [ 788.368312] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 788.368584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.210552] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 789.211044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.211269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.211609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.211942] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.213183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.215105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.215105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.215105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.215105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.215105] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.715826] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.219693] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fb31477-cec0-4034-8f2e-e510893e6ddf: rpc.has_security_group_logging(os_id): False [ 790.237389] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.237590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.237733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.237899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.238010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.238308] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.238433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.238501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.238725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.241799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.241799] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be created. [ 790.290705] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.290981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.290981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.291163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.291356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.301598] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 790.628450] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ea16e26-22a9-4051-94c9-b1b6a0eafe0b req-28627827-026c-49aa-bfcf-347587b5be5a tempest-ServersTestManualDisk-1834955542 tempest-ServersTestManualDisk-1834955542-project-member] Enqueued Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_members [ 790.630488] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 with Priority: HIGHEST for action security_group_members [ 790.630488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.630665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.630697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.630892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.631085] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.631192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.631267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.631424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.631510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.631605] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed04af6-5d88-4a9b-a4a4-60feb8636b45',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.135689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.135689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.136115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.136115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.136115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.136283] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.136397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.136454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.136765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.136765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.136765] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 is going to be updated. [ 791.164129] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.164129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.164129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.164129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.164428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.173578] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 in Status: IN_PROGRESS for 2s [ 792.051367] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7a18efbd-2c90-4790-abc6-65794d490073 None None] Enqueued Resource ID: b57c91fa-def0-4504-9b4e-4a615997e4c5 with Priority: HIGHEST for action port [ 792.052236] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b57c91fa-def0-4504-9b4e-4a615997e4c5 with Priority: HIGHEST for action port [ 792.053266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b57c91fa-def0-4504-9b4e-4a615997e4c5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.053363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b57c91fa-def0-4504-9b4e-4a615997e4c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.053430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b57c91fa-def0-4504-9b4e-4a615997e4c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.053685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b57c91fa-def0-4504-9b4e-4a615997e4c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.053768] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b57c91fa-def0-4504-9b4e-4a615997e4c5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.314831] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 792.314831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.556777] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b57c91fa-def0-4504-9b4e-4a615997e4c5 [ 792.557476] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.557476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.557476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.557662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.557662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.557662] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b57c91fa-def0-4504-9b4e-4a615997e4c5 already deleted. [ 792.557770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b57c91fa-def0-4504-9b4e-4a615997e4c5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.185854] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 in Status: SUCCESS [ 793.186148] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed04af6-5d88-4a9b-a4a4-60feb8636b45 deletion is rescheduled due to dependency. [ 793.186335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed04af6-5d88-4a9b-a4a4-60feb8636b45" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.561232] env[69728]: INFO networking_nsxv3.common.synchronization [req-2044fbdb-c94b-4e85-a158-b587f402d791 req-0643599b-f58d-4d1d-a2d4-0d96e8d857b4 tempest-DeleteServersAdminTestJSON-668290985 tempest-DeleteServersAdminTestJSON-668290985-project-member] Enqueued Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 793.562058] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e88d88-3454-4e14-8364-c48e1d31646f with Priority: HIGHEST for action security_group_members [ 793.562430] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e88d88-3454-4e14-8364-c48e1d31646f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.562527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.562596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.562798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.562950] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.563088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.563127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.563301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.563346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.563432] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e88d88-3454-4e14-8364-c48e1d31646f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.065479] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.065684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.065789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.066028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.066123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.066312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.066407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.066490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.066617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.066691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.066775] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f is going to be updated. [ 794.095655] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.096042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.096042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.096574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.096764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.105975] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: IN_PROGRESS for 2s [ 794.890046] env[69728]: INFO networking_nsxv3.common.synchronization [None req-59083a50-5c50-4f2c-bae2-5bb934e891e9 None None] Enqueued Resource ID: b7969509-c76c-4f8c-971f-cb9e2caab0e6 with Priority: HIGHEST for action port [ 794.890749] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7969509-c76c-4f8c-971f-cb9e2caab0e6 with Priority: HIGHEST for action port [ 794.892550] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7969509-c76c-4f8c-971f-cb9e2caab0e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.892550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7969509-c76c-4f8c-971f-cb9e2caab0e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.892975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7969509-c76c-4f8c-971f-cb9e2caab0e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.892975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7969509-c76c-4f8c-971f-cb9e2caab0e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.892975] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7969509-c76c-4f8c-971f-cb9e2caab0e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.401128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7969509-c76c-4f8c-971f-cb9e2caab0e6 [ 795.401128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.401128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.401128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.401128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.401128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.401128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7969509-c76c-4f8c-971f-cb9e2caab0e6 already deleted. [ 795.401128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7969509-c76c-4f8c-971f-cb9e2caab0e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.464823] env[69728]: INFO networking_nsxv3.common.synchronization [req-c5357890-aefa-4277-b324-96626787dc95 req-e8ba8c8b-b000-4ae4-b8e3-cd23ba0e3a82 tempest-ServersAdminNegativeTestJSON-1903866848 tempest-ServersAdminNegativeTestJSON-1903866848-project-member] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 795.465445] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 795.465777] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.465917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.465986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.467562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.467707] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.467823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.467898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.468071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.468164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.468262] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.504114] env[69728]: INFO networking_nsxv3.common.synchronization [req-340ab1fd-cdd7-429e-954f-c11a158a1e8c req-ba10acab-ff7a-440d-b4df-ca8a5262e81e tempest-ServerGroupTestJSON-371707604 tempest-ServerGroupTestJSON-371707604-project-member] Enqueued Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_members [ 795.508748] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_members [ 795.508933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.511357] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.511357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.511357] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.893677] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.894037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-881" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.894037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-881" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.894367] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-881" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.894646] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.894804] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.894944] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.895185] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.895352] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.895546] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.895712] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.895771] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.895909] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.895978] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 795.896111] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.896254] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.917536] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.917924] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 795.917924] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.918046] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-881" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.920862] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-3babdb73-50a0-49ba-92f5-6f70beff45f7 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.920862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.920862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.920862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.920862] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3babdb73-50a0-49ba-92f5-6f70beff45f7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.971424] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.014197] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.014355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.014355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.014557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.014651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.014853] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.014949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.015032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.015186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.015264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.015347] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 already deleted. [ 796.015426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.116039] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e88d88-3454-4e14-8364-c48e1d31646f in Status: SUCCESS [ 796.116261] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e88d88-3454-4e14-8364-c48e1d31646f deletion is rescheduled due to dependency. [ 796.116448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e88d88-3454-4e14-8364-c48e1d31646f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.423056] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.423056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.423056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.423056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.423374] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.423374] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 3babdb73-50a0-49ba-92f5-6f70beff45f7 not found, creating... [ 796.423522] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.423665] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.423780] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.424011] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.424160] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.424433] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.424591] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.424707] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.424912] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.425146] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.425277] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 3babdb73-50a0-49ba-92f5-6f70beff45f7 is going to be created. [ 796.444553] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.444783] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.444911] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.445208] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.445440] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.445660] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.472442] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.974975] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.975292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.975292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.978529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.978641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.978794] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be updated. [ 797.005608] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.005758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.005841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.006089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.006927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.018025] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: IN_PROGRESS for 2s [ 797.453194] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc97b8d6-2b93-4443-ad84-d84be928701d req-3df45f61-6f30-47fe-97ef-5a42b7f55ab8 tempest-ServerAddressesTestJSON-1264343726 tempest-ServerAddressesTestJSON-1264343726-project-member] Enqueued Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_members [ 797.454084] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_members [ 797.454437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.454569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.454636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.454892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.455077] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.455179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.455242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.455376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.455470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.455574] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.958213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.958364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.958441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.958641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.958734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.958999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.959189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.959243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.959387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.959470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.959573] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444c2dd6-94e3-450f-a206-be350b315f8e already deleted. [ 797.959666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.077221] env[69728]: INFO networking_nsxv3.common.synchronization [req-340ab1fd-cdd7-429e-954f-c11a158a1e8c req-5879ed95-7e2e-4082-98df-f35067601bba service nova] Enqueued Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_rules [ 798.077479] env[69728]: INFO networking_nsxv3.common.synchronization [req-340ab1fd-cdd7-429e-954f-c11a158a1e8c req-5879ed95-7e2e-4082-98df-f35067601bba service nova] Enqueued Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_members [ 798.077553] env[69728]: INFO networking_nsxv3.common.synchronization [req-340ab1fd-cdd7-429e-954f-c11a158a1e8c req-5879ed95-7e2e-4082-98df-f35067601bba service nova] Enqueued Resource ID: 3babdb73-50a0-49ba-92f5-6f70beff45f7 with Priority: HIGHEST for action port [ 798.078089] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_rules [ 798.078240] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_members [ 798.078342] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3babdb73-50a0-49ba-92f5-6f70beff45f7 with Priority: HIGHEST for action port [ 798.078644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.078835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.078914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.079543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.079635] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.080519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.080636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.080702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.080879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.081144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.081144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.081247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.081351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.081434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.081517] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.086148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3babdb73-50a0-49ba-92f5-6f70beff45f7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.086148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.086148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.086148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.086148] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3babdb73-50a0-49ba-92f5-6f70beff45f7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.391564] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-351 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.391765] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-351" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.391910] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-351" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.393048] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-351" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.393320] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.393532] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.393661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.393903] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.394061] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.394274] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.394385] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.394491] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.394598] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.394706] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.394809] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.394942] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.411572] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.411712] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.411890] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.412035] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-351" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.412352] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.412522] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.412641] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.412968] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.413133] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf8e910-01a8-4f6f-ac1d-f58d0960c272',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.585974] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.588824] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.588951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.589113] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3babdb73-50a0-49ba-92f5-6f70beff45f7 with status ACTIVE [ 798.589276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.589378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.589438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.589778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.589778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.589870] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.589963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.590101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.590266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.590345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.590585] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.590682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.591101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.591260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.591338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.591422] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3babdb73-50a0-49ba-92f5-6f70beff45f7 is going to be updated. [ 798.609836] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.609973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.610019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.610200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.610327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.610482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3babdb73-50a0-49ba-92f5-6f70beff45f7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.916398] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.916716] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.916852] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.917165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.917335] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.917493] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port bbf8e910-01a8-4f6f-ac1d-f58d0960c272 not found, creating... [ 798.917764] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.917952] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.918099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.918302] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.918453] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.918739] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.918922] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.919077] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.919294] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.919428] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.920058] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: bbf8e910-01a8-4f6f-ac1d-f58d0960c272 is going to be created. [ 798.940922] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.941150] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.941291] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.941605] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.941984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.942290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.026592] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 799.026902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.089485] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.592773] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.592773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.592773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.593076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.593076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.593146] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 is going to be created. [ 799.616558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.616558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.616558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.616558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.616558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.624782] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 in Status: UNINITIALIZED for 2s [ 799.829939] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc97b8d6-2b93-4443-ad84-d84be928701d req-ff13f3a4-6fd2-4c61-b2bf-731a3af4ede0 service nova] Enqueued Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_rules [ 799.830127] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc97b8d6-2b93-4443-ad84-d84be928701d req-ff13f3a4-6fd2-4c61-b2bf-731a3af4ede0 service nova] Enqueued Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_members [ 799.830335] env[69728]: INFO networking_nsxv3.common.synchronization [req-dc97b8d6-2b93-4443-ad84-d84be928701d req-ff13f3a4-6fd2-4c61-b2bf-731a3af4ede0 service nova] Enqueued Resource ID: bbf8e910-01a8-4f6f-ac1d-f58d0960c272 with Priority: HIGHEST for action port [ 799.830488] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_rules [ 799.834018] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_members [ 799.834018] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf8e910-01a8-4f6f-ac1d-f58d0960c272 with Priority: HIGHEST for action port [ 799.834018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.834018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.834018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.834018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.834018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.835014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.835014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.835014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.837967] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.837967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.837967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.837967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.837967] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf8e910-01a8-4f6f-ac1d-f58d0960c272',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.101369] env[69728]: INFO networking_nsxv3.common.synchronization [None req-710de3ca-3ac5-446c-91d5-a5f33e1954e9 tempest-MigrationsAdminTest-770467406 tempest-MigrationsAdminTest-770467406-project-member] Enqueued Resource ID: 17130324-659e-4f0e-9e0e-4120816bac19 with Priority: HIGHEST for action security_group_rules [ 800.101937] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17130324-659e-4f0e-9e0e-4120816bac19 with Priority: HIGHEST for action security_group_rules [ 800.102263] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17130324-659e-4f0e-9e0e-4120816bac19 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.102385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.102452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.102690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.102772] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17130324-659e-4f0e-9e0e-4120816bac19',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.231426] env[69728]: INFO networking_nsxv3.common.synchronization [None req-65604cff-bff7-4c08-bc7f-54de81e55f98 tempest-MigrationsAdminTest-770467406 tempest-MigrationsAdminTest-770467406-project-member] Enqueued Resource ID: 17130324-659e-4f0e-9e0e-4120816bac19 with Priority: HIGHEST for action security_group_rules [ 800.231426] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17130324-659e-4f0e-9e0e-4120816bac19 with Priority: HIGHEST for action security_group_rules [ 800.231628] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17130324-659e-4f0e-9e0e-4120816bac19 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.233020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.333898] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.334304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.339973] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.342351] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbf8e910-01a8-4f6f-ac1d-f58d0960c272 with status ACTIVE [ 800.342351] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.342351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.342351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.342351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.342351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.342351] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.342351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.342351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.342786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.342786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.342786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.342899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.342899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.343129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.343129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.343258] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbf8e910-01a8-4f6f-ac1d-f58d0960c272 is going to be updated. [ 800.372699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.372841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.372919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.373149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.373293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.373454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf8e910-01a8-4f6f-ac1d-f58d0960c272" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.636649] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.638154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.638154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.638154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.638154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.638154] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17130324-659e-4f0e-9e0e-4120816bac19 already deleted. [ 800.638154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.641214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.641407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.641499] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17130324-659e-4f0e-9e0e-4120816bac19',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.845697] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.163158] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.163158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.163158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.163158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.163158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.163158] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17130324-659e-4f0e-9e0e-4120816bac19 already deleted. [ 801.163158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17130324-659e-4f0e-9e0e-4120816bac19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.351060] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.351060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.351060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.351060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.351060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.351060] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444c2dd6-94e3-450f-a206-be350b315f8e is going to be created. [ 801.373032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.373032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.373032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.373032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.373032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.380328] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444c2dd6-94e3-450f-a206-be350b315f8e in Status: UNINITIALIZED for 2s [ 801.600424] env[69728]: INFO networking_nsxv3.common.synchronization [req-1cf4affa-b3e7-42d9-8a33-4802e1079d6a req-2f0ce772-f0d2-44a1-9a2a-3a4a1c9dd260 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 801.600424] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 801.600424] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.600424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.600424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.600845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.601126] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.601339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.601487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.601857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.602074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.602271] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.638804] env[69728]: INFO networking_nsxv3.common.synchronization [req-1cf4affa-b3e7-42d9-8a33-4802e1079d6a req-2f0ce772-f0d2-44a1-9a2a-3a4a1c9dd260 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 801.639226] env[69728]: INFO networking_nsxv3.common.synchronization [req-1cf4affa-b3e7-42d9-8a33-4802e1079d6a req-2f0ce772-f0d2-44a1-9a2a-3a4a1c9dd260 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 801.640881] env[69728]: INFO networking_nsxv3.common.synchronization [req-1cf4affa-b3e7-42d9-8a33-4802e1079d6a req-2f0ce772-f0d2-44a1-9a2a-3a4a1c9dd260 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: 52d4541c-a6f8-451f-bc69-246c209af27a with Priority: HIGHEST for action port [ 801.641963] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 in Status: SUCCESS [ 801.642321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.643430] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 801.643639] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 801.643830] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4541c-a6f8-451f-bc69-246c209af27a with Priority: HIGHEST for action port [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.645026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.645026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.645026] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.646493] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.646737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.646937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.647309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.648351] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.648546] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.648636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.648821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-52d4541c-a6f8-451f-bc69-246c209af27a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.651275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.651275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.651275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.651275] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52d4541c-a6f8-451f-bc69-246c209af27a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.107363] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.151972] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.152070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.152221] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52d4541c-a6f8-451f-bc69-246c209af27a with status ACTIVE [ 802.152390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.152499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.152565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.152771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.152861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.153045] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.153146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.153210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.153565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.153565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.153632] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.153720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.153783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.154050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.154050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.154124] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52d4541c-a6f8-451f-bc69-246c209af27a is going to be updated. [ 802.155354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.155514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.155607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.155768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.155922] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.156035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.156088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.156237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.156317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.156402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.156546] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.156653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.156720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.156830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.156972] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.157077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.157140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.157279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.157381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.157429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.157515] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.187198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.187485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.187485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.187608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.189881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.189881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.609703] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.660072] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85f5da8c-306b-4e81-b46f-c1ac511985b0: rpc.has_security_group_logging(os_id): False [ 802.679155] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.679327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.679327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.679528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.679617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.679843] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.679992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.680141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.680265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.680265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.680453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.680583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.680583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.680730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.680802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.680999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.681094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.681186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.681322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.681397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.681481] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 is going to be created. [ 802.733651] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.733791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.733866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.734118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.734283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.744140] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 in Status: IN_PROGRESS for 2s [ 803.116132] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.116233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.116296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.116533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.116627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.116730] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 803.145743] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.146731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.146731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.146731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.146731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.159857] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 803.356186] env[69728]: INFO networking_nsxv3.common.synchronization [req-4635e568-2251-43dd-8c8a-ee9098afb7d9 req-fda05ec2-0dd9-4a17-b9c4-090a45ae16b5 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 803.356418] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 803.358066] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.358235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.358324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.358568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.361184] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.361184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.361184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.361184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.361184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.361184] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.393652] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444c2dd6-94e3-450f-a206-be350b315f8e in Status: SUCCESS [ 803.393652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.394036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.394249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.394472] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.394591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.394656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.394813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.394941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.395059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.395153] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.735585] env[69728]: INFO networking_nsxv3.common.synchronization [req-500994c4-98ba-40fa-bc2d-813bd9bd5051 req-4889b448-99a3-4828-9806-aa02c298fc01 tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 803.736133] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 803.736439] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.736559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.736631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.736830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.736978] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.737169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.737245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.737406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.737493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.737590] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.862169] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.899718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.900149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.900149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.900276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.900375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.900476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.901600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.901600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.901600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.901600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.901600] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.901600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.901805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.901805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.903039] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.903039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.903039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.903039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.903039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.903039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.903039] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.085829] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-140 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.086038] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.086165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.086422] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.086766] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.086882] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.087010] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.087233] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.087375] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.087586] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.087696] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.087812] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.087921] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.088037] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.088141] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.088270] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.106790] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.106909] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.107091] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.107237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-140" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.107518] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-8d087345-523a-47d8-a46f-0e6f6a2e865c taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.107676] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.107794] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.108106] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.108247] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d087345-523a-47d8-a46f-0e6f6a2e865c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.242908] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.243084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.243158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.243372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.243476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.243675] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.243772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.243834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.243984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.244079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.244167] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 804.288744] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.289053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.289186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.289444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.290199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.302000] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 804.364429] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.406177] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 444c2dd6-94e3-450f-a206-be350b315f8e: rpc.has_security_group_logging(os_id): False [ 804.425359] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.425510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.425590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.425855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.425969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.426309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.426458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.426533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.426712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.426955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.427186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.427294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.427359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.427521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.427599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.427783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.427873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.427938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.428101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.428177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.428264] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 444c2dd6-94e3-450f-a206-be350b315f8e is going to be created. [ 804.487019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.487019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.487019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.487019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.487019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.497650] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 444c2dd6-94e3-450f-a206-be350b315f8e in Status: IN_PROGRESS for 2s [ 804.617235] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.617235] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 8d087345-523a-47d8-a46f-0e6f6a2e865c not found, creating... [ 804.617235] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.617235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.617688] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.617688] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.617688] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.617688] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.617688] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.617688] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c is going to be created. [ 804.637381] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.637381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.637381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.637381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.637381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.637381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.757551] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 in Status: SUCCESS [ 804.757551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.871159] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.871392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.871499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.871781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.871892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.872012] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 804.902193] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.902471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.902471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.902684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.902834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.911587] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 804.974426] env[69728]: INFO networking_nsxv3.common.synchronization [req-096e57c7-6ab5-4600-8fc7-d9f1bb3c1315 req-d1bf5139-5417-4c9b-afa4-2d153f86f138 tempest-ServersTestFqdnHostnames-1351333799 tempest-ServersTestFqdnHostnames-1351333799-project-member] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_members [ 804.974980] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGHEST for action security_group_members [ 804.975308] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.975438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.975507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.975715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.975969] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.976091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.976091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.976206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.976296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.976397] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.166954] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 805.167204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.167399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.167637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.167855] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.167978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.168063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.168238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.168321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.168443] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.478475] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.478771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.478771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.479583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.479583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.479583] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.479583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.479583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.479583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.479583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.479820] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 is going to be updated. [ 805.513558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.513711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.513803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.513990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.514149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.522639] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339553a7-1e43-4dfd-9442-5889c248b938 in Status: IN_PROGRESS for 2s [ 805.671057] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.019033] env[69728]: INFO networking_nsxv3.common.synchronization [req-224fe749-990b-42dc-a656-4e162da1e1d9 req-94f6f433-f2a5-4599-ba57-7f1fe1def234 tempest-ServerRescueTestJSON-853328931 tempest-ServerRescueTestJSON-853328931-project-member] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 806.019420] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 806.019730] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.019852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.019915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.020737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.020979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.021111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.021173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.021369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.021462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.021560] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.175803] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.314595] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 806.314771] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 806.314885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.442297] env[69728]: INFO networking_nsxv3.common.synchronization [req-4635e568-2251-43dd-8c8a-ee9098afb7d9 req-ad1d3a83-9b63-4e0c-8261-1d3c73a5de8d service nova] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 806.442527] env[69728]: INFO networking_nsxv3.common.synchronization [req-4635e568-2251-43dd-8c8a-ee9098afb7d9 req-ad1d3a83-9b63-4e0c-8261-1d3c73a5de8d service nova] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 806.442734] env[69728]: INFO networking_nsxv3.common.synchronization [req-4635e568-2251-43dd-8c8a-ee9098afb7d9 req-ad1d3a83-9b63-4e0c-8261-1d3c73a5de8d service nova] Enqueued Resource ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c with Priority: HIGHEST for action port [ 806.443374] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 806.443574] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 806.443709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c with Priority: HIGHEST for action port [ 806.444345] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.444505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.444582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.444839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.445034] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.446036] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.446149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.446399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d087345-523a-47d8-a46f-0e6f6a2e865c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.446538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.446614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.446885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.446980] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d087345-523a-47d8-a46f-0e6f6a2e865c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.512137] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 444c2dd6-94e3-450f-a206-be350b315f8e in Status: SUCCESS [ 806.512856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.524207] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.524394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.524446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.524649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.524738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.524933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.525048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.525111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.525289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.525366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.525683] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd already deleted. [ 806.525683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.617140] env[69728]: INFO networking_nsxv3.common.synchronization [req-b089c4a2-9e50-4507-b3ab-1bc1ad8ea2f0 req-ff96d630-dbf7-4d41-9125-d27f2502aaef tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 806.617527] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 806.617796] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.618093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.674714] env[69728]: INFO networking_nsxv3.common.synchronization [req-b089c4a2-9e50-4507-b3ab-1bc1ad8ea2f0 req-ff96d630-dbf7-4d41-9125-d27f2502aaef tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 806.675024] env[69728]: INFO networking_nsxv3.common.synchronization [req-b089c4a2-9e50-4507-b3ab-1bc1ad8ea2f0 req-ff96d630-dbf7-4d41-9125-d27f2502aaef tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 806.676231] env[69728]: INFO networking_nsxv3.common.synchronization [req-b089c4a2-9e50-4507-b3ab-1bc1ad8ea2f0 req-ff96d630-dbf7-4d41-9125-d27f2502aaef tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: 52d4541c-a6f8-451f-bc69-246c209af27a with Priority: HIGHEST for action port [ 806.677218] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_rules [ 806.677392] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 806.677466] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52d4541c-a6f8-451f-bc69-246c209af27a with Priority: HIGHEST for action port [ 806.677972] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.678119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.678188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.678393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.678483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.678581] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 806.681767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.681947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.682227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.682318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.682499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-52d4541c-a6f8-451f-bc69-246c209af27a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.682598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.682662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.682848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.682941] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52d4541c-a6f8-451f-bc69-246c209af27a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.711789] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.712080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.712080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.712407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.712735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.722995] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 806.921295] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 806.921550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.921667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.921935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.922146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.922261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.922328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.922481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.922565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.922665] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.948927] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.949115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.949299] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d087345-523a-47d8-a46f-0e6f6a2e865c with status ACTIVE [ 806.949467] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.949572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.949636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.949836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.949923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.950113] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.950209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.950272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.950428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.950508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.950690] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.950776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.950833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.951015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.951095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.951178] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c is going to be updated. [ 806.972805] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.972959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.973042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.973254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.973388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.973541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.992183] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.992183] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.992389] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.992584] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.992853] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.993555] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.993747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.993994] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.994161] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.994367] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.994483] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.994591] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.994754] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.994929] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.995387] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.995387] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.020274] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.020479] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 807.020619] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.020798] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.021234] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-7ef511d6-867c-4370-b694-7339a87b5ace taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.021369] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.021488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.021786] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.021933] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef511d6-867c-4370-b694-7339a87b5ace',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.192314] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52d4541c-a6f8-451f-bc69-246c209af27a with status ACTIVE [ 807.192580] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.192745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.192822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.193062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.193174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.193354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.193456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.193521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.193695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.193772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.193970] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.194095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.194156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.194691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.194784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.194902] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52d4541c-a6f8-451f-bc69-246c209af27a is going to be updated. [ 807.216540] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.216699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.216739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.217019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.217166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.217342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52d4541c-a6f8-451f-bc69-246c209af27a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.425471] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.525902] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.526399] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.526604] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.526888] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.527209] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.527415] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 7ef511d6-867c-4370-b694-7339a87b5ace not found, creating... [ 807.527692] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.528123] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.528287] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.528547] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.528902] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.529325] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.529604] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.529805] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.530174] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.530354] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.530501] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 7ef511d6-867c-4370-b694-7339a87b5ace is going to be created. [ 807.539058] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339553a7-1e43-4dfd-9442-5889c248b938 in Status: SUCCESS [ 807.539262] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 deletion is rescheduled due to dependency. [ 807.539370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.550132] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.550366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.550494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.550760] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.550984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.551229] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.930107] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.411657] env[69728]: INFO networking_nsxv3.common.synchronization [req-e195ec46-ff37-4dd2-b080-66773b400403 req-1dbd69db-bf22-44a4-8581-862b02de3739 tempest-ImagesNegativeTestJSON-912769117 tempest-ImagesNegativeTestJSON-912769117-project-member] Enqueued Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_members [ 808.412253] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_members [ 808.412719] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.412870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.412870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.417227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.418084] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.418084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.418084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.418419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.418419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.418419] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.433519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.433830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.433830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.434061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.434176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.434314] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 808.463932] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.464209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.464209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.464422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.464571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.473220] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 808.681760] env[69728]: INFO networking_nsxv3.common.synchronization [req-224fe749-990b-42dc-a656-4e162da1e1d9 req-28c1f69c-21ed-4484-92d7-5589ad5bb6bb service nova] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_rules [ 808.682046] env[69728]: INFO networking_nsxv3.common.synchronization [req-224fe749-990b-42dc-a656-4e162da1e1d9 req-28c1f69c-21ed-4484-92d7-5589ad5bb6bb service nova] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 808.682046] env[69728]: INFO networking_nsxv3.common.synchronization [req-224fe749-990b-42dc-a656-4e162da1e1d9 req-28c1f69c-21ed-4484-92d7-5589ad5bb6bb service nova] Enqueued Resource ID: 7ef511d6-867c-4370-b694-7339a87b5ace with Priority: HIGHEST for action port [ 808.682543] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_rules [ 808.682676] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 808.682772] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ef511d6-867c-4370-b694-7339a87b5ace with Priority: HIGHEST for action port [ 808.683674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.683851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.683953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.684298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.684870] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.685822] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.686038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.686038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.686190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.686355] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.686447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.686508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.686672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.686753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.686844] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.689675] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ef511d6-867c-4370-b694-7339a87b5ace taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.689880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.689880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.690113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.690234] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ef511d6-867c-4370-b694-7339a87b5ace',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.733131] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 808.733379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.733559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.733790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.734013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.734168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.734250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.734443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.734528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.734617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.734730] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.735579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.735771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.735961] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.736239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.736320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.736484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.736567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.736660] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.924843] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.924843] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.924843] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a already deleted. [ 808.924843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.178270] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.178270] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-830" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.178448] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-830" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.178741] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-830" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.179094] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.179283] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.179409] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.179634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.179799] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.180100] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.181187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.181187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.181187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.181187] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.181187] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.181187] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.195623] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.195623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.195623] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.196499] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ef511d6-867c-4370-b694-7339a87b5ace with status ACTIVE [ 809.196675] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.197047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.197047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.197132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.197231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.197403] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.197589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.197589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.197727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.197819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.198033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.198215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.198508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.198508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.198508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.198681] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ef511d6-867c-4370-b694-7339a87b5ace is going to be updated. [ 809.212129] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.212342] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.212506] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.212750] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-830" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.213163] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-6bb37c7d-9db9-4e87-be4f-230aa968252e taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.213402] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.213582] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.213922] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.214107] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb37c7d-9db9-4e87-be4f-230aa968252e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.219674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.219854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.219973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.220239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.220426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.220661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ef511d6-867c-4370-b694-7339a87b5ace" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.244350] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.245264] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.700796] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.716424] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.716704] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.716841] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.717182] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.717336] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.717516] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 6bb37c7d-9db9-4e87-be4f-230aa968252e not found, creating... [ 809.717795] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.717958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.718087] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.718338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.718481] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.718885] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.719209] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.719400] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.719712] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.719916] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.720155] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 6bb37c7d-9db9-4e87-be4f-230aa968252e is going to be created. [ 809.746872] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.747145] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.747312] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.747633] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.747894] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.748169] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.749117] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c4b88c-3e7a-48c7-84e2-371c7b5dffef: rpc.has_security_group_logging(os_id): False [ 809.750241] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.768862] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.769074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.769259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.769499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.769596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.769857] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.769991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.770082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.770245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.770348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.770422] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 809.856436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.856625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.856722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.856976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.857253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.872765] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 810.205856] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.206113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.206220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.206504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.206556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.206715] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be created. [ 810.224146] env[69728]: INFO networking_nsxv3.common.synchronization [req-de9b4e62-fe68-417e-a51e-75fa108725b9 req-1e0f3c41-bfb4-46c3-ba8b-22c7fe00bb49 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 810.224700] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 810.225616] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.225773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.225841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.226112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.226295] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.226666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.226734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.226903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.226996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.227127] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.232219] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.232363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.233044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.233479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.233662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.244807] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: UNINITIALIZED for 2s [ 810.254145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.254330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.254407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.254626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.254727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.254824] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 810.279559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.279720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.279798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.280147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.280322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.295092] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 810.485960] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.485960] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.485960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.485960] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.730651] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.731071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.731071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.731736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.731882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.732192] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.732486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.732486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.732866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.732938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.733079] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b already deleted. [ 810.733229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.830712] env[69728]: INFO networking_nsxv3.common.synchronization [req-e195ec46-ff37-4dd2-b080-66773b400403 req-1557a587-08a3-42af-88bd-fbf1bf4304eb service nova] Enqueued Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_rules [ 810.831434] env[69728]: INFO networking_nsxv3.common.synchronization [req-e195ec46-ff37-4dd2-b080-66773b400403 req-1557a587-08a3-42af-88bd-fbf1bf4304eb service nova] Enqueued Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_members [ 810.831610] env[69728]: INFO networking_nsxv3.common.synchronization [req-e195ec46-ff37-4dd2-b080-66773b400403 req-1557a587-08a3-42af-88bd-fbf1bf4304eb service nova] Enqueued Resource ID: 6bb37c7d-9db9-4e87-be4f-230aa968252e with Priority: HIGHEST for action port [ 810.832202] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_rules [ 810.832383] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_members [ 810.832518] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bb37c7d-9db9-4e87-be4f-230aa968252e with Priority: HIGHEST for action port [ 810.832877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.833068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.833165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.833492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.833597] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.835136] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.835391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.835491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.835711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.836135] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.836403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.836502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.836702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.837014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.837218] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.842155] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bb37c7d-9db9-4e87-be4f-230aa968252e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.842350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.842448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.842690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.842895] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bb37c7d-9db9-4e87-be4f-230aa968252e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.893863] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.896136] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.896136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.896136] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.896136] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.896136] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.896136] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.896136] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 810.896136] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.896582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.914090] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.914264] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 810.914399] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.914561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.914864] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f1c509eb-3895-4a45-bcdb-8dd1dec30443 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.915049] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.915185] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.915483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.915616] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1c509eb-3895-4a45-bcdb-8dd1dec30443',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.986818] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.986990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.987065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.987288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.987499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.987613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.987679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.987833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.987919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.988016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.988175] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.988272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.988332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.988471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.988607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.988696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.988754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.988897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.989813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.989813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.989813] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.067397] env[69728]: INFO networking_nsxv3.common.synchronization [req-cd993cc6-6af2-4302-a1f5-0c160787254d req-0d7e438a-1a49-4122-9ece-378530abd626 tempest-ServerGroupTestJSON-371707604 tempest-ServerGroupTestJSON-371707604-project-member] Enqueued Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_members [ 811.068175] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGHEST for action security_group_members [ 811.068830] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.069108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.071417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.071417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.071417] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.071417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.071417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.071417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.071417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.071417] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.345385] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bb37c7d-9db9-4e87-be4f-230aa968252e with status ACTIVE [ 811.345675] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.345829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.345902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.346146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.346251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.346418] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.346578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.346725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.346802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.347013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.347131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.347217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.347317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.347411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.347546] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bb37c7d-9db9-4e87-be4f-230aa968252e is going to be updated. [ 811.349681] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.349810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.349951] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.371451] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.374150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.374150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.374150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.374150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.374150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bb37c7d-9db9-4e87-be4f-230aa968252e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.418214] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.418532] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.418642] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.419018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.419165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.419343] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f1c509eb-3895-4a45-bcdb-8dd1dec30443 not found, creating... [ 811.419678] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.419867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.420008] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.420278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.420465] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.420786] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.420954] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.421148] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.421403] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.421551] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.421693] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f1c509eb-3895-4a45-bcdb-8dd1dec30443 is going to be created. [ 811.439304] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.440037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.440037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.440037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.440246] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.440373] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.491893] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e3be409-32bc-4a01-bfa9-d2153d5679f3: rpc.has_security_group_logging(os_id): False [ 811.520996] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.521329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.521329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.521469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.521545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.521763] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.521852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.521920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.522083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.522167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.522343] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.522450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.522503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.523108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.523108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.523108] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.523108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.523108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.523705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.523705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.523705] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 811.572302] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.572505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.572568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.572831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.572933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.573217] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.573380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.573446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.573555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.573634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.573723] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 is going to be updated. [ 811.615142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.615142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.615142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.615142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.615142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.617247] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.618126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.618371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.618756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.619076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.628664] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 in Status: IN_PROGRESS for 2s [ 811.633549] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 811.857562] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.886550] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 811.886882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.887416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.887658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.887768] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.254520] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 812.254749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.255051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.255145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.255340] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.255458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.255516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.255675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.256165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.256165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.256165] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.304242] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 812.304463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.304625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.304829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.305026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.305139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.305254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.305353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.305429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.305528] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.361660] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.361770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.362127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.362127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.362234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.362276] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a is going to be created. [ 812.384546] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.384752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.384819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.385118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.385288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.395020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.395020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.395020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a in Status: UNINITIALIZED for 2s [ 812.632899] env[69728]: INFO networking_nsxv3.common.synchronization [req-de9b4e62-fe68-417e-a51e-75fa108725b9 req-ce321f24-9e84-4dac-b73e-c26a8e2afcbf service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 812.633112] env[69728]: INFO networking_nsxv3.common.synchronization [req-de9b4e62-fe68-417e-a51e-75fa108725b9 req-ce321f24-9e84-4dac-b73e-c26a8e2afcbf service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 812.633180] env[69728]: INFO networking_nsxv3.common.synchronization [req-de9b4e62-fe68-417e-a51e-75fa108725b9 req-ce321f24-9e84-4dac-b73e-c26a8e2afcbf service nova] Enqueued Resource ID: f1c509eb-3895-4a45-bcdb-8dd1dec30443 with Priority: HIGHEST for action port [ 812.633406] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 812.633526] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 812.633651] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1c509eb-3895-4a45-bcdb-8dd1dec30443 with Priority: HIGHEST for action port [ 812.635707] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.635707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.635864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.636803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.636803] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.637227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.637418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.637843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.638102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.639366] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.639366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.639366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.639366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.639366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.639366] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.639949] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1c509eb-3895-4a45-bcdb-8dd1dec30443 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.640037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.640144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.640358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.641179] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1c509eb-3895-4a45-bcdb-8dd1dec30443',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.759157] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.759326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.759364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.759550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.759716] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.759877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.759942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.760109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.760198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.760286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.760434] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.760525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.760589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.760818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.761024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.761179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.761262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.761432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.761539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.761651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.761762] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.807865] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.143009] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.143351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.143412] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.144333] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1c509eb-3895-4a45-bcdb-8dd1dec30443 with status ACTIVE [ 813.144525] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.144646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.144697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.144885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.144973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.145165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.145264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.145320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.145473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.145550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.146101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.146101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.146101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.146101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.148958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.149140] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1c509eb-3895-4a45-bcdb-8dd1dec30443 is going to be updated. [ 813.168773] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.168954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.169396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.169396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.169396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.169562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1c509eb-3895-4a45-bcdb-8dd1dec30443" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.263894] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c6e384a-728d-49a1-9e35-3c446ee4ccdd: rpc.has_security_group_logging(os_id): False [ 813.282135] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.282479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.282521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.282726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.282814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.283014] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.283146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.283180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.285024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.285024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.285024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.285024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.285024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.285024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.287184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.287418] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.287520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.287584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.287746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.287824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.287909] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be created. [ 813.314405] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.350101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.350250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.350320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.350529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.350701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.362661] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: IN_PROGRESS for 2s [ 813.387995] env[69728]: INFO networking_nsxv3.common.synchronization [req-d0fd96f1-faf5-4b90-a0f5-ea8ee6d43c9e req-f2fede41-1bed-4507-9d88-49bdc8165742 tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 813.388645] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 813.388969] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.389566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.389641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.389929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.390117] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.390217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.390276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.390435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.390520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.390607] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.639228] env[69728]: INFO networking_nsxv3.common.synchronization [req-f9a928d3-03cb-4f29-a2a7-53bffd78f179 req-e906a86e-3ee4-4168-af48-8655ff45f880 tempest-AttachInterfacesUnderV243Test-117272043 tempest-AttachInterfacesUnderV243Test-117272043-project-member] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 813.640107] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 in Status: SUCCESS [ 813.640280] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 deletion is rescheduled due to dependency. [ 813.640389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.640835] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGHEST for action security_group_members [ 813.642221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.642331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.650280] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 813.650374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.650886] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.816362] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.816536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.816606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.816836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.816960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.817112] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 813.858119] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.858323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.858323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.858549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.858702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.872422] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 813.893081] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.893267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.893395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.893559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.893654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.893859] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.893958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.894076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.894186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.894269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.894358] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 already deleted. [ 813.894440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.153635] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.154331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.154474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.154721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.154823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.154931] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be created. [ 814.175948] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.176212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.176296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.176651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.177444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.186460] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: UNINITIALIZED for 2s [ 814.242055] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.242273] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.242402] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.242679] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.242938] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.243466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.243642] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.243880] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.244164] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.244448] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.244997] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.245431] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.245619] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.246204] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 814.246351] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.246497] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.267891] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.268189] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 814.268488] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.268714] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.269307] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-0160ffdd-109f-4e10-822d-5ceebaa5ee50 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.269579] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.269734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.271471] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.271687] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0160ffdd-109f-4e10-822d-5ceebaa5ee50',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.404547] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a in Status: SUCCESS [ 814.404856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.405093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.405372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.405632] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.405759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.405850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.406062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.406150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.406262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.406365] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.774899] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.774899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.774899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.774899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.775272] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.775272] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 0160ffdd-109f-4e10-822d-5ceebaa5ee50 not found, creating... [ 814.775551] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.775713] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.775830] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776069] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.776214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.776499] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.776652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.776767] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.776973] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.777123] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.777333] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 0160ffdd-109f-4e10-822d-5ceebaa5ee50 is going to be created. [ 814.796536] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.796707] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.796816] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.797099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.797325] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.797543] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.908890] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.910365] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.910365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.910723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.910723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.910798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.910870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.911046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.911198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.911333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.911430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.911637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.911780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.911919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.912054] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.375849] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 815.376623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.415682] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f61f5e11-f2e6-46da-a533-dd1d28e67b4a: rpc.has_security_group_logging(os_id): False [ 815.433032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.433032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.433032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.433032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.433898] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.434174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.434371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.436329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.436329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.436329] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a is going to be created. [ 815.496604] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.496751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.496823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.497142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.497314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.519804] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a in Status: IN_PROGRESS for 2s [ 815.882899] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 815.883100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.883294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.883515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.883732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.883870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.883931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.884131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.884221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.884331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.884435] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.885484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.885571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.885655] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.885763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.885847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.885993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.886085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.886174] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.186509] env[69728]: INFO networking_nsxv3.common.synchronization [req-d0fd96f1-faf5-4b90-a0f5-ea8ee6d43c9e req-5235a9cf-74a2-4680-845e-af3ebcb0c350 service nova] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_rules [ 816.186762] env[69728]: INFO networking_nsxv3.common.synchronization [req-d0fd96f1-faf5-4b90-a0f5-ea8ee6d43c9e req-5235a9cf-74a2-4680-845e-af3ebcb0c350 service nova] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 816.186963] env[69728]: INFO networking_nsxv3.common.synchronization [req-d0fd96f1-faf5-4b90-a0f5-ea8ee6d43c9e req-5235a9cf-74a2-4680-845e-af3ebcb0c350 service nova] Enqueued Resource ID: 0160ffdd-109f-4e10-822d-5ceebaa5ee50 with Priority: HIGHEST for action port [ 816.188595] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_rules [ 816.188767] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 816.188831] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0160ffdd-109f-4e10-822d-5ceebaa5ee50 with Priority: HIGHEST for action port [ 816.189203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.189381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.189475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.189708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.189805] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.191931] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.191931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.191931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.192355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.192776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.192776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.192952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.193141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.193141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.193272] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.198315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0160ffdd-109f-4e10-822d-5ceebaa5ee50 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.198315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.198315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.198315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.198315] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0160ffdd-109f-4e10-822d-5ceebaa5ee50',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.207596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 816.207596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.207596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.207797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.207961] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.208093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.208180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.208397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.208397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.208823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.208823] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.315783] env[69728]: INFO networking_nsxv3.common.synchronization [req-95191998-aa55-43f0-8ea8-e2530b68a885 req-05902e21-f02d-4800-af5b-d730673a8d75 tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 816.317228] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 816.317497] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.317658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.317716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.318105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.318316] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.318437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.318503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.318680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.318767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.318861] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.387939] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.389133] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.389306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.389375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.389588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.389684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.389874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.389969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.390040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.390362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.390463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.390560] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 816.422211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.422362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.422433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.422650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.422792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.430954] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 816.697631] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.699255] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.699379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.700847] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0160ffdd-109f-4e10-822d-5ceebaa5ee50 with status ACTIVE [ 816.700847] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.700936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.700979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.701188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.701280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.701534] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.701640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.701710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.701914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.701967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.702194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.702262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.702307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.702441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.702519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.702606] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0160ffdd-109f-4e10-822d-5ceebaa5ee50 is going to be updated. [ 816.712866] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.713889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.714014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.714606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.715377] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.715547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.716672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.716877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.716971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.717125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.717311] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.717411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.717468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.717626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.717767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.717861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.717924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.718083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.718166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.718248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.718339] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.725073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.725891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.727394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.727394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.727394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.727394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0160ffdd-109f-4e10-822d-5ceebaa5ee50" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.821712] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.821865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.821938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.822185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.822281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.822499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.822596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.822647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.822803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.822879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.822961] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda already deleted. [ 816.823052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.894689] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c4b88c-3e7a-48c7-84e2-371c7b5dffef: rpc.has_security_group_logging(os_id): False [ 816.913776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.913776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.913776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.913776] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be updated. [ 816.980327] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.980510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.980585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.980835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.980995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.997719] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: IN_PROGRESS for 2s [ 817.057290] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.057290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.057290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.057290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.057290] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.057290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.057290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.057558] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.058279] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.058279] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.058279] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 817.058499] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 817.058499] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 817.058644] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 817.058808] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 817.059035] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 817.079747] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 817.079747] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 817.079747] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 817.079747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.079747] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-47f5abb4-bcf9-4735-9503-5701eac1c829 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.079747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.079747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.080202] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.080202] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f5abb4-bcf9-4735-9503-5701eac1c829',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.202373] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.209160] env[69728]: INFO networking_nsxv3.common.synchronization [req-f38eceec-ead6-4d12-bea7-0a0e778f8912 req-3bbbbbf4-b30c-4388-8767-4a0a0631bdf0 tempest-ServerAddressesTestJSON-1264343726 tempest-ServerAddressesTestJSON-1264343726-project-member] Enqueued Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_members [ 817.209694] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 444c2dd6-94e3-450f-a206-be350b315f8e with Priority: HIGHEST for action security_group_members [ 817.209991] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-444c2dd6-94e3-450f-a206-be350b315f8e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.210139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.210255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.210507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.210655] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.210801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.210906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.211052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.211137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.211228] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('444c2dd6-94e3-450f-a206-be350b315f8e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.222379] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00587369-d416-4d4c-b7d8-d80624c5056b: rpc.has_security_group_logging(os_id): False [ 817.243401] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.243593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.243667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.244877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.244877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.244877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.244877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.244877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.244877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.244877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.244877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.245200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.245200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.245200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.245299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.245787] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.245787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.245787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.245787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.246061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.246061] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be created. [ 817.308907] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.308907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.308907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.308907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.308907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.325319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 817.533232] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a in Status: SUCCESS [ 817.533603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.582732] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.582900] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.583022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.583370] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.583551] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.583711] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 47f5abb4-bcf9-4735-9503-5701eac1c829 not found, creating... [ 817.583972] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.584151] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.584267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.584491] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.584639] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.584978] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.585181] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.585299] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.586432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.586432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.586432] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 47f5abb4-bcf9-4735-9503-5701eac1c829 is going to be created. [ 817.604583] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.604583] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.604583] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.604583] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.604809] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.605028] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.705121] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.705266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.705266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.705504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.705605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.705887] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be created. [ 817.714764] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.714971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.715050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.715261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.715386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.715591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.715688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.715756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.715906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.715996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.716149] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444c2dd6-94e3-450f-a206-be350b315f8e is going to be updated. [ 817.855206] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.855296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.855436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.856165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.856165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.864716] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.864943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.865174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.865749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.865830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.868348] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: UNINITIALIZED for 2s [ 817.873962] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444c2dd6-94e3-450f-a206-be350b315f8e in Status: IN_PROGRESS for 2s [ 818.439650] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 818.439869] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef deletion is rescheduled due to dependency. [ 818.440080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.862653] env[69728]: INFO networking_nsxv3.common.synchronization [req-95191998-aa55-43f0-8ea8-e2530b68a885 req-3e9a5601-0ca2-4189-8ff1-acf205489900 service nova] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_rules [ 818.862895] env[69728]: INFO networking_nsxv3.common.synchronization [req-95191998-aa55-43f0-8ea8-e2530b68a885 req-3e9a5601-0ca2-4189-8ff1-acf205489900 service nova] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 818.863066] env[69728]: INFO networking_nsxv3.common.synchronization [req-95191998-aa55-43f0-8ea8-e2530b68a885 req-3e9a5601-0ca2-4189-8ff1-acf205489900 service nova] Enqueued Resource ID: 47f5abb4-bcf9-4735-9503-5701eac1c829 with Priority: HIGHEST for action port [ 818.863651] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_rules [ 818.863861] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 818.863926] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f5abb4-bcf9-4735-9503-5701eac1c829 with Priority: HIGHEST for action port [ 818.867144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.867303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.867421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.867770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.868962] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.870124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.870321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.870431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.870631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.870812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.870926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.871550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.871784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.871897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.872078] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.876027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f5abb4-bcf9-4735-9503-5701eac1c829 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.876027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.876027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.876027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.876027] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f5abb4-bcf9-4735-9503-5701eac1c829',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.976696] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 818.976863] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 818.977403] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 818.979180] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 818.979180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.979180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.979180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.980565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.980565] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.980684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.980684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.981044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.981044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.981044] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.982393] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.982515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.982581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.985733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.986058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.989787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.989787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.989787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.989787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.989787] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.993884] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.010899] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef in Status: SUCCESS [ 819.010899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.136777] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_rules [ 819.136962] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 819.137267] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 819.137267] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 819.137380] env[69728]: INFO networking_nsxv3.common.synchronization [req-e139e22a-e9b8-473c-822b-3e56a6cbb000 req-b1102cc4-af97-4258-b587-ddb146d2d4bd tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c with Priority: HIGHEST for action port [ 819.137927] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_rules [ 819.141032] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 819.141032] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c with Priority: HIGHEST for action port [ 819.141032] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 819.141032] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 819.141032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.141032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.142094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.142094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.142094] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.145647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.145647] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.145647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d087345-523a-47d8-a46f-0e6f6a2e865c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.145647] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d087345-523a-47d8-a46f-0e6f6a2e865c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.145647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.145647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.145647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.146421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.160017] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a6847b4-c706-438f-b6c4-85126c5a0504 req-c289a227-3e74-42a4-ba25-d5003e82a72a tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 819.160569] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 819.164369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.164369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.164369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.164369] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.336936] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 819.337225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.377890] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.378053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.378266] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.379201] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47f5abb4-bcf9-4735-9503-5701eac1c829 with status ACTIVE [ 819.379394] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.379506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.379571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.379773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.379861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.380040] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.380135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.380198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.380348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.380423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.380603] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.380693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.380751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.380887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.380959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.381362] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47f5abb4-bcf9-4735-9503-5701eac1c829 is going to be updated. [ 819.426525] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.427558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.427654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.427876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.428027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.428206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f5abb4-bcf9-4735-9503-5701eac1c829" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.495789] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.496870] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.647374] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.647540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.647820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.647907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.648075] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d087345-523a-47d8-a46f-0e6f6a2e865c with status ACTIVE [ 819.648230] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.648343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.648429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.648651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.648737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.648909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.649018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.649084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.649267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.649352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.649538] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.649630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.649691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.649832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.649909] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.649993] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c is going to be updated. [ 819.664968] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.665130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.665197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.665425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.665501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.665665] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.665756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.665815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.665957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.666041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.666125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 819.670966] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.671135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.671225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.671437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.671593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.671782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.691544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.691741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.691809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.692041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.692234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.707315] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 819.750193] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.750435] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.750561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.750821] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.751144] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.751319] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.751452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.751684] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.751833] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.752968] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.753202] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.753355] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.753471] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.753592] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 819.753696] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.753842] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.782395] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.782587] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 819.782740] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.782905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.783252] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.783461] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.784286] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.784653] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.784837] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fc49c5-dd5d-49e9-9612-8d85c63b73e9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.877881] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: SUCCESS [ 819.878222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.878484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.878843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.879069] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.879271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.879573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.879573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.879674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.879757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.879854] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.881597] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 444c2dd6-94e3-450f-a206-be350b315f8e in Status: SUCCESS [ 819.885249] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 444c2dd6-94e3-450f-a206-be350b315f8e deletion is rescheduled due to dependency. [ 819.885396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-444c2dd6-94e3-450f-a206-be350b315f8e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.885699] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.998535] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.998696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.998759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.998984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.999801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.999801] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 820.000464] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.042637] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.042815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.042862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.043076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.043222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.055147] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 820.290288] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.290288] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 not found, creating... [ 820.290288] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.290288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.290917] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.290917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.290917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.290917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.290917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.290917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 is going to be created. [ 820.311230] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.311230] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.311230] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.311448] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.313401] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.313401] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.388121] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.388304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.388378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.388585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.388677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.388778] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be created. [ 820.390146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.390266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.390337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.390501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.390652] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.391313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.391313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.394247] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.394247] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.394247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.394247] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.422257] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.422257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.422257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.422257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.422257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.436727] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: UNINITIALIZED for 2s [ 820.508415] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.508415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.508415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.508415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.508415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.508415] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be created. [ 820.532565] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.532565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.532565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.532565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.532565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.541884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: UNINITIALIZED for 2s [ 820.898395] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c57c1ff9-39aa-42db-8159-2c763d036946: rpc.has_security_group_logging(os_id): False [ 820.915943] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.915943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.915943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.915943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.915943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.916313] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.916313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.916419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.916488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.916624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.916730] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.916816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.916867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.917021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.917103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.917261] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.917356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.917418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.918684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.918684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.918684] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be created. [ 820.971303] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.971528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.971575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.971811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.971998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.986941] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: IN_PROGRESS for 2s [ 821.484568] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a6847b4-c706-438f-b6c4-85126c5a0504 req-744c6fbd-b40f-4960-b9b8-015ea5098b48 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 821.484568] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a6847b4-c706-438f-b6c4-85126c5a0504 req-744c6fbd-b40f-4960-b9b8-015ea5098b48 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 821.484568] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a6847b4-c706-438f-b6c4-85126c5a0504 req-744c6fbd-b40f-4960-b9b8-015ea5098b48 service nova] Enqueued Resource ID: c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 with Priority: HIGHEST for action port [ 821.484568] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 821.484760] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 821.484760] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 with Priority: HIGHEST for action port [ 821.485739] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.486509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.486634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.486868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.486982] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.487852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.487983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.488218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.488352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.488418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.488607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.488689] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2fc49c5-dd5d-49e9-9612-8d85c63b73e9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.717283] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 821.717488] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 821.717603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.717777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.718024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.718215] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.718347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.718468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.718576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.718656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.718762] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.991421] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 with status ACTIVE [ 821.994554] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.994554] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.994554] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.994554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.994554] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2fc49c5-dd5d-49e9-9612-8d85c63b73e9 is going to be updated. [ 821.995306] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.995306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.015644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.015797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.015858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.016056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.016184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.016334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2fc49c5-dd5d-49e9-9612-8d85c63b73e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.061826] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 822.062054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.062221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.062428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.062607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.062723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.062788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.062935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.063027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.063141] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.223125] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.448829] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 822.449299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.449698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.449857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.451148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.451348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.451391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.451629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.452710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.452814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.452922] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.550909] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 822.551180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.551335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.551553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.551748] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.551869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.551956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.552153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.552267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.552331] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.564936] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.726265] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.957312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.957312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.957312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.957312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.957312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.957312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.957600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.957600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.957600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.957789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.957789] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.957967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.957967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.958095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.958481] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.958481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.958481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.958596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.958596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.958655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.958768] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.003113] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: SUCCESS [ 823.003363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.054204] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.067334] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.230732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.230914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.230991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.231243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.231353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.231500] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 823.286182] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.286337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.286382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.286842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.286842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.305674] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 823.463078] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05a124ad-1f1b-4827-93f7-8088f013edda: rpc.has_security_group_logging(os_id): False [ 823.489034] env[69728]: INFO networking_nsxv3.common.synchronization [req-0965c5b5-b4fb-468d-bc9d-73293520ed2c req-9a196fdf-5a3a-44a6-9c92-8effabc936e1 tempest-ImagesNegativeTestJSON-912769117 tempest-ImagesNegativeTestJSON-912769117-project-member] Enqueued Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_members [ 823.490319] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGHEST for action security_group_members [ 823.491760] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.491944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.492025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.493122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.493273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.493495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.493644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.493773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.493926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.494051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.494265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.494374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.494453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.494638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.494716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.495138] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.495276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.495342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.495496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.495618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.495723] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be created. [ 823.497937] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.498113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.498178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.498340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.499072] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.499237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.499358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.499470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.499590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.499646] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.556708] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.570957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.571153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.571212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.572102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.572102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.572102] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 823.602917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.603069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.603146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.603360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.603642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.621604] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.621708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.621750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.622038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.622231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.630204] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 823.636792] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 824.005077] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.005372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.005513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.005942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.006119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.006368] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.006474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.006545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.006726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.006808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.006897] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a is going to be updated. [ 824.061885] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.061885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.061885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.061885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.061885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.061885] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be updated. [ 824.123118] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.123245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.123349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.123653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.123851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.129800] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.130105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.130105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.130451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.130522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.143229] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a in Status: IN_PROGRESS for 2s [ 824.144036] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: IN_PROGRESS for 2s [ 825.318357] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 825.318873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.318873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.319045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.319303] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.319438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.319506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.321552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.321552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.321552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.321552] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.647335] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 825.647563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.647729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.647958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.648163] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.648280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.648343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.648522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.648658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.648722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.648808] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.650369] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 825.650563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.827032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.827032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.827032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.827032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.827032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.827866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.827866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.827866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.827866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.827866] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.155501] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.155501] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.155501] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.155501] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.155501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.156138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.156138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.156138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.156256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.156308] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.157917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 826.158148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.158965] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a in Status: SUCCESS [ 826.159221] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a deletion is rescheduled due to dependency. [ 826.159386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.160613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.160613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.160613] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.334654] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc: rpc.has_security_group_logging(os_id): False [ 826.356812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.357019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.357079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.357985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.357985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.357985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.357985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.358311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.362074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.362284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.362550] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.362668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.362735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.362923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.363049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.363255] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.363356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.363418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.363581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.363648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.364046] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 826.425590] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.426233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.426233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.426233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.426233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.438865] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 826.663008] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e3be409-32bc-4a01-bfa9-d2153d5679f3: rpc.has_security_group_logging(os_id): False [ 826.664353] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.682930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.683120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.683197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.683475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.683705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.683965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.684099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.684178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.684346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.684482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.684678] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.684775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.684849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.684992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.685160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.685382] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.685581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.685581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.685716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.685807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.685934] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 826.745377] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.745569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.747041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.747041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.747041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.761065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 827.031322] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 827.031502] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_members [ 827.031642] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 827.032205] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 827.032355] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_members [ 827.032455] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 827.032730] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.032854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.032914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.033145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.033307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.033408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.033469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.033620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.033706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.033803] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.034607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a0fdcc2-28c6-49d2-8834-6aa026527787 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.034721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.034787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.034996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.035590] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.035699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.035767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.035923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.036010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.036123] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.036835] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.036945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.041133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.041437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.041437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.041637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.041637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.041749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.041833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.041920] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.134209] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_rules [ 827.134382] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 827.134518] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 827.134714] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 827.134877] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_rules [ 827.135016] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_members [ 827.135147] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d6badcc-e4f4-4269-8a44-1bd60d376331 req-ada71f3f-2252-4025-980d-9d9aec793350 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c with Priority: HIGHEST for action port [ 827.135653] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_rules [ 827.135793] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_rules [ 827.135893] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_members [ 827.135984] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c with Priority: HIGHEST for action port [ 827.136085] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_rules [ 827.136304] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 827.136454] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 827.136870] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.137035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.137296] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.137400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.137587] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a0fdcc2-28c6-49d2-8834-6aa026527787 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.137667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.137838] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d087345-523a-47d8-a46f-0e6f6a2e865c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.137978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.138022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.138245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.138331] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d087345-523a-47d8-a46f-0e6f6a2e865c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.139486] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a0fdcc2-28c6-49d2-8834-6aa026527787 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.139602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.139670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.139896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.139974] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.140729] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.144160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.144365] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.144454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.154276] env[69728]: INFO networking_nsxv3.common.synchronization [req-6aaabb18-6667-4691-97f0-1ce54c2ad766 req-cd924bb9-f8b8-4bf9-a60c-d390e80766c7 tempest-ListServerFiltersTestJSON-1638024464 tempest-ListServerFiltersTestJSON-1638024464-project-member] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 827.154815] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 827.155133] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.155252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.155320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.155549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.155716] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.155814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.155877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.157163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.157294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.157398] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.167634] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 150816be-2a89-4f94-a1c1-0b956d39c86e: rpc.has_security_group_logging(os_id): False [ 827.194679] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.194919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.196054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.196054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.196054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.196054] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.196054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.196054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.196368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.196368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.196368] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be created. [ 827.263198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.263340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.264303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.264303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.264303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.273984] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: IN_PROGRESS for 2s [ 827.545776] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.550475] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.551742] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.646621] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d087345-523a-47d8-a46f-0e6f6a2e865c with status ACTIVE [ 827.646835] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.647052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.650067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.650067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.650067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.650067] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.650067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.650067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.651116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.651246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.652210] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.652210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.652210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.652361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.652547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.652547] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d087345-523a-47d8-a46f-0e6f6a2e865c is going to be updated. [ 827.654837] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a0fdcc2-28c6-49d2-8834-6aa026527787 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.654837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.662019] env[69728]: INFO networking_nsxv3.common.synchronization [req-161fe0ba-6dc5-4aca-bb20-b665fe526ac9 req-3dbee8e8-216f-4562-a991-1f2b153f79d1 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 827.662019] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 827.662019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.662019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.662019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.664480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.664663] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.664770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.664832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.665047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.665170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.665280] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.667169] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.667290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.667374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.667522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.667604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.667779] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.667864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.667924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.668080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.668155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.668245] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a already deleted. [ 827.668320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.677363] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.677596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.677668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.677857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.677985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.678153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d087345-523a-47d8-a46f-0e6f6a2e865c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.924777] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.925147] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.925147] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.925802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.930025] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.930025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.930025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.930025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.930025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.930025] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.930025] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.930025] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.930025] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.930025] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.930025] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.930025] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.953532] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.953859] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.954049] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.954314] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.954779] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-645400d1-c93b-4274-9bab-bee529082e25 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.955063] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.955337] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.955720] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.955931] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645400d1-c93b-4274-9bab-bee529082e25',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.054276] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.054716] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.055406] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.088906] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3cc197bc-974b-4c40-b2a7-4ba793f9540f None None] Enqueued Resource ID: 750f0e3d-d1c0-48d5-aed1-9e96088ded1c with Priority: HIGHEST for action port [ 828.089200] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 750f0e3d-d1c0-48d5-aed1-9e96088ded1c with Priority: HIGHEST for action port [ 828.089836] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-750f0e3d-d1c0-48d5-aed1-9e96088ded1c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.089836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-750f0e3d-d1c0-48d5-aed1-9e96088ded1c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.090101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-750f0e3d-d1c0-48d5-aed1-9e96088ded1c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.093123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-750f0e3d-d1c0-48d5-aed1-9e96088ded1c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.093123] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('750f0e3d-d1c0-48d5-aed1-9e96088ded1c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.170172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.170370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.170446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.170664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.170761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.170957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.171067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.171134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.171289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.171536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.171536] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 828.201420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.201609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.201718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.201979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.202184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.216133] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 828.452024] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 828.452024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.461456] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.461700] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.461829] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.462144] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.462292] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.462448] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 645400d1-c93b-4274-9bab-bee529082e25 not found, creating... [ 828.462722] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.462879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.462998] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.463267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.463423] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.463712] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.463869] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.463987] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.464513] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.464657] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.464800] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 645400d1-c93b-4274-9bab-bee529082e25 is going to be created. [ 828.501464] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.501826] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.502067] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.502504] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.502884] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.503250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.558265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.558556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.558556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.558707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.558804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.558892] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 828.560489] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.560581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.560637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.560795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.561123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.561198] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be updated. [ 828.562181] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.562286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.562360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.562512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.562589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.562741] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 is going to be created. [ 828.598317] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 750f0e3d-d1c0-48d5-aed1-9e96088ded1c [ 828.598555] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.598692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.598755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.598978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.599082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.599181] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:750f0e3d-d1c0-48d5-aed1-9e96088ded1c already deleted. [ 828.599299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-750f0e3d-d1c0-48d5-aed1-9e96088ded1c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.629515] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.629640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.631906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.631906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.631906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.638072] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.638072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.638072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.638072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.638072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.638072] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.638072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.638072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.638416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.638416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.657037] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: IN_PROGRESS for 2s [ 828.657985] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 828.662822] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 in Status: UNINITIALIZED for 2s [ 828.779150] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 828.779621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.779838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.780076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.780160] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.285554] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 829.285782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.286212] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.286375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.286551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.286716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.286788] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.595728] env[69728]: INFO networking_nsxv3.common.synchronization [req-6aaabb18-6667-4691-97f0-1ce54c2ad766 req-9dffb9d8-19f2-4c43-b059-c2012ff57135 service nova] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_rules [ 829.596024] env[69728]: INFO networking_nsxv3.common.synchronization [req-6aaabb18-6667-4691-97f0-1ce54c2ad766 req-9dffb9d8-19f2-4c43-b059-c2012ff57135 service nova] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 829.596182] env[69728]: INFO networking_nsxv3.common.synchronization [req-6aaabb18-6667-4691-97f0-1ce54c2ad766 req-9dffb9d8-19f2-4c43-b059-c2012ff57135 service nova] Enqueued Resource ID: 645400d1-c93b-4274-9bab-bee529082e25 with Priority: HIGHEST for action port [ 829.596883] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_rules [ 829.597655] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 829.597836] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645400d1-c93b-4274-9bab-bee529082e25 with Priority: HIGHEST for action port [ 829.598236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.598397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.598487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.598813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.598926] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.600134] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.600363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.600363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.600678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.600881] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.601028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.601102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.601304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.601420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.601543] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.603222] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-645400d1-c93b-4274-9bab-bee529082e25 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.603365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.603455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.603655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.603773] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645400d1-c93b-4274-9bab-bee529082e25',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.790628] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.790628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.106712] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.106923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.107079] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.108865] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 645400d1-c93b-4274-9bab-bee529082e25 with status ACTIVE [ 830.109072] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.109196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.109358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.110291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.110431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.110902] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.110902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.111078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.111118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.111202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.111648] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.111820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.111820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.111973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.112861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.112861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 645400d1-c93b-4274-9bab-bee529082e25 is going to be updated. [ 830.142069] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.142237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.142278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.142546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.142684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.142862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-645400d1-c93b-4274-9bab-bee529082e25" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.231233] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 830.231908] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b deletion is rescheduled due to dependency. [ 830.231908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.541041] env[69728]: INFO networking_nsxv3.common.synchronization [None req-decdfe39-a830-4230-803b-54cbd51462d6 None None] Enqueued Resource ID: 59453720-0fc7-4c7e-af20-fcab1f7e0d63 with Priority: HIGHEST for action port [ 830.542041] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59453720-0fc7-4c7e-af20-fcab1f7e0d63 with Priority: HIGHEST for action port [ 830.542041] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-59453720-0fc7-4c7e-af20-fcab1f7e0d63 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.542276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59453720-0fc7-4c7e-af20-fcab1f7e0d63" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.542276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59453720-0fc7-4c7e-af20-fcab1f7e0d63" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.542593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59453720-0fc7-4c7e-af20-fcab1f7e0d63" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.542714] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59453720-0fc7-4c7e-af20-fcab1f7e0d63',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.617127] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.667883] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 830.668758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.668758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.668758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.668758] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.668983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.668983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.669166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.669327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.669439] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.671605] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 in Status: SUCCESS [ 830.671851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.672543] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 830.672954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.673573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.673753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.673926] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.674101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.674101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.674247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.674355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.674593] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.675120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.675634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.675634] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.675766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.675766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.675889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.675968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.676121] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.045112] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59453720-0fc7-4c7e-af20-fcab1f7e0d63 [ 831.045376] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.045515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.045598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.045815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.045907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.046013] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59453720-0fc7-4c7e-af20-fcab1f7e0d63 already deleted. [ 831.046097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59453720-0fc7-4c7e-af20-fcab1f7e0d63" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.121426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.121604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.121659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.121862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.121952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.122062] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be created. [ 831.146481] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.146665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.146715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.146887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.147070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.155435] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: UNINITIALIZED for 2s [ 831.178095] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.179633] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.180777] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.643424] env[69728]: INFO networking_nsxv3.common.synchronization [req-73849dc6-c387-4761-85ba-96dc6504c38a req-dd7f37be-2957-442b-952c-9038f99abdce tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 831.643717] env[69728]: INFO networking_nsxv3.common.synchronization [req-73849dc6-c387-4761-85ba-96dc6504c38a req-dd7f37be-2957-442b-952c-9038f99abdce tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_members [ 831.643823] env[69728]: INFO networking_nsxv3.common.synchronization [req-73849dc6-c387-4761-85ba-96dc6504c38a req-dd7f37be-2957-442b-952c-9038f99abdce tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 831.644362] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 831.644519] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 with Priority: HIGHEST for action security_group_members [ 831.644664] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 150816be-2a89-4f94-a1c1-0b956d39c86e with Priority: HIGHEST for action security_group_members [ 831.644964] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.645495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.645751] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a0fdcc2-28c6-49d2-8834-6aa026527787 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.645856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.646100] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-150816be-2a89-4f94-a1c1-0b956d39c86e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.646195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.664638] env[69728]: INFO networking_nsxv3.common.synchronization [req-19ec7593-41f9-4fa6-bab4-529ae9b2b302 req-dec99ca5-073c-43df-a754-3ff3936e0174 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_members [ 831.664906] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGHEST for action security_group_members [ 831.665441] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.665561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.665626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.665834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.666180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.666180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.666180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.666349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.666434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.666538] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.682966] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.683851] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.684681] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.168952] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.168952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.169116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.169270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.169396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.169631] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.169732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.169837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.169968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.170061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.170154] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 is going to be updated. [ 832.188271] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.188447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.188514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.188720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.188820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.188935] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 is going to be updated. [ 832.192071] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.192218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.192290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.192510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.192613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.192706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 832.194013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.194137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.194225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.194408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.194504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.194593] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be updated. [ 832.229955] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.229955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.229955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.229955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.229955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.244244] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 in Status: IN_PROGRESS for 2s [ 832.249118] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.249274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.249402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.249620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.249806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.252146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.255018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.255018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.267804] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 832.268641] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: IN_PROGRESS for 2s [ 832.269339] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 in Status: IN_PROGRESS for 2s [ 833.165049] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 833.165485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.165695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.165799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.166033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.166192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.166281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.166414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.166498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.166561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.166638] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.669416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.669572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.669665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.669984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.670172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.670306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.670422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.670633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.670753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.670813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.670961] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.671073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.671118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.671263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.671404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.671471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.671529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.671679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.671756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.671838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.671978] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.174077] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69ded0e1-c75f-440b-abf9-1fb132e0a59a: rpc.has_security_group_logging(os_id): False [ 834.196520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.196819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.196928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.197333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.197563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.198192] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.198192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.198192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.198489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.198691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.199116] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.199294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.199455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.199689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.199769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.200042] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.200242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.200313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.200490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.200606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.200735] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be created. [ 834.253366] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 in Status: SUCCESS [ 834.253366] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 deletion is rescheduled due to dependency. [ 834.253578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.260891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.260891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.260891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.261186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.262108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.274302] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 834.280449] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 834.280800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.281548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.281817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.282088] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.282239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.282330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.282652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.282735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.282849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.282967] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.284741] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 in Status: SUCCESS [ 834.284990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.285884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 834.290279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.290698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.290895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.291506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.291506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.291506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.291506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.291506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.291506] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.292451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.292620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.292794] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.292903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.292961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.293126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.293207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.293328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.293426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.294469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.294663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.294833] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.295133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.295133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.295198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.295270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.295356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.295449] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.299100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.299404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.299630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.299756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.299822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.299982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.300086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.300194] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.301347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.301511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.301679] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.301784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.301848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.301992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.302089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.302185] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.797777] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.797907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.797986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.798347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.798509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.798814] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.798892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.798926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.799137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.799255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.799397] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be updated. [ 834.800483] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('150816be-2a89-4f94-a1c1-0b956d39c86e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.804098] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.804210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.804274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.804429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.804511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.804682] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.804776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.804832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.804973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.805060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.805142] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 is going to be deleted. [ 834.805981] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a0fdcc2-28c6-49d2-8834-6aa026527787',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.806674] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.810112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.810207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.830500] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.830500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.830500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.830500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.830500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.839473] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: IN_PROGRESS for 2s [ 834.840484] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.841319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.841319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.841319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.841319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.841319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.303271] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 150816be-2a89-4f94-a1c1-0b956d39c86e: rpc.has_security_group_logging(os_id): False [ 835.309356] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a0fdcc2-28c6-49d2-8834-6aa026527787: rpc.has_security_group_logging(os_id): False [ 835.310436] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.322677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.322819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.322890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.323110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.323202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.323437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.323607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.323769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.323827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.323906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.324011] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e is going to be updated. [ 835.325939] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.326060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.326132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.326288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.326368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.326570] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.326669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.326734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.326876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.326953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.327049] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 is going to be created. [ 835.342555] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9a0fdcc2-28c6-49d2-8834-6aa026527787], does not exist path=[/infra/domains/default/groups/9a0fdcc2-28c6-49d2-8834-6aa026527787]."\n}' [ 835.342694] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9a0fdcc2-28c6-49d2-8834-6aa026527787 [ 835.342773] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 835.380035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.380035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.380035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.380260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.380396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.382887] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.383018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.383142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.383325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.384609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.384883] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.385024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.385103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.385493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.385607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.386266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.386266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.386266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.386266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.386266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.386266] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a0fdcc2-28c6-49d2-8834-6aa026527787 is going to be created. [ 835.400475] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: IN_PROGRESS for 2s [ 835.406934] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9a0fdcc2-28c6-49d2-8834-6aa026527787], does not exist path=[/infra/domains/default/groups/9a0fdcc2-28c6-49d2-8834-6aa026527787]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9a0fdcc2-28c6-49d2-8834-6aa026527787 [ 835.407161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a0fdcc2-28c6-49d2-8834-6aa026527787" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.407851] env[69728]: Traceback (most recent call last): [ 835.407923] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 835.407923] env[69728]: return func(*args, **kwargs) [ 835.407923] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 835.407923] env[69728]: res.raise_for_status() [ 835.407923] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 835.407923] env[69728]: raise HTTPError(http_error_msg, response=self) [ 835.407923] env[69728]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9a0fdcc2-28c6-49d2-8834-6aa026527787 [ 835.407923] env[69728]: During handling of the above exception, another exception occurred: [ 835.407923] env[69728]: Traceback (most recent call last): [ 835.407923] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 835.407923] env[69728]: listener.cb(fileno) [ 835.407923] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 835.407923] env[69728]: result = function(*args, **kwargs) [ 835.407923] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 835.407923] env[69728]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 835.407923] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 835.407923] env[69728]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 835.407923] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 835.407923] env[69728]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 835.407923] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 835.407923] env[69728]: res.raise_for_status() [ 835.408688] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 835.408688] env[69728]: raise HTTPError(http_error_msg, response=self) [ 835.408688] env[69728]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9a0fdcc2-28c6-49d2-8834-6aa026527787 [ 835.408688] env[69728]: Removing descriptor: 34 [ 835.817458] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.817700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.817747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.817952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.818041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.818157] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 835.850946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.851101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.851444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.851444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.851711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.860680] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 836.077361] env[69728]: INFO networking_nsxv3.common.synchronization [req-8858bd8b-5216-4c54-b605-e9432c1f9bf2 req-49696b20-4fd0-4be8-9884-e989fe8a66f5 tempest-ServersAdminNegativeTestJSON-1903866848 tempest-ServersAdminNegativeTestJSON-1903866848-project-member] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 836.077361] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGHEST for action security_group_members [ 836.077521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.077583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.077617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.077879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.077948] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.078134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.078200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.078351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.078433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.078528] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.285626] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 836.286078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.587396] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.587777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.587777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.587998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.607795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.608128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.608279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.608384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.608644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.608753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.608876] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be updated. [ 836.634653] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.634653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.635349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.635349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.635678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.644670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: IN_PROGRESS for 2s [ 836.848608] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 836.849440] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 150816be-2a89-4f94-a1c1-0b956d39c86e deletion is rescheduled due to dependency. [ 836.849440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.413094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 150816be-2a89-4f94-a1c1-0b956d39c86e in Status: SUCCESS [ 837.413336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-150816be-2a89-4f94-a1c1-0b956d39c86e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.874795] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 837.875148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.875360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.875716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.876055] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.876277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.876434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.876710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.876888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.876977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.877181] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.877322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.877480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.877596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.877799] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.878040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.878193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.878447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.878569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.878710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.878886] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.382281] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e3be409-32bc-4a01-bfa9-d2153d5679f3: rpc.has_security_group_logging(os_id): False [ 838.400092] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.400092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.400092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.400092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.420031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.420031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.420031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.420031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.420031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.420432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.420432] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.420432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.420710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.420710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.420710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.421112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.421112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.421112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.421276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.421276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.421376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 838.475031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.475134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.475209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.475422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.475620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.487423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 838.533577] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e97487c4-9178-4bd3-92e8-0ef43ca1204e None None] Enqueued Resource ID: 3acfe1b1-92ba-47ed-a6fb-104de5fec99d with Priority: HIGHEST for action port [ 838.533960] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3acfe1b1-92ba-47ed-a6fb-104de5fec99d with Priority: HIGHEST for action port [ 838.534551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3acfe1b1-92ba-47ed-a6fb-104de5fec99d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.534695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3acfe1b1-92ba-47ed-a6fb-104de5fec99d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.534779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3acfe1b1-92ba-47ed-a6fb-104de5fec99d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.535011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3acfe1b1-92ba-47ed-a6fb-104de5fec99d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.535464] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3acfe1b1-92ba-47ed-a6fb-104de5fec99d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.654139] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 in Status: SUCCESS [ 838.654139] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 deletion is rescheduled due to dependency. [ 838.654139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.039560] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3acfe1b1-92ba-47ed-a6fb-104de5fec99d [ 839.039560] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.039932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.039932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.039932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.040059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.040298] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3acfe1b1-92ba-47ed-a6fb-104de5fec99d already deleted. [ 839.040298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3acfe1b1-92ba-47ed-a6fb-104de5fec99d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.500837] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 840.501147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.814767] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a11792cf-7289-4439-8d99-9627e94fb62b None None] Enqueued Resource ID: 9530d1f3-ea46-423f-938d-224c9f8440e6 with Priority: HIGHEST for action port [ 840.815365] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9530d1f3-ea46-423f-938d-224c9f8440e6 with Priority: HIGHEST for action port [ 840.815678] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9530d1f3-ea46-423f-938d-224c9f8440e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.815803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9530d1f3-ea46-423f-938d-224c9f8440e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.815871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9530d1f3-ea46-423f-938d-224c9f8440e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.816137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9530d1f3-ea46-423f-938d-224c9f8440e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.816224] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9530d1f3-ea46-423f-938d-224c9f8440e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.849853] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a8291d4e-17a7-4553-868e-0c5645b36bf8 None None] Enqueued Resource ID: 8240d973-a8c6-4622-9757-1caf2a42bdd2 with Priority: HIGHEST for action port [ 840.850421] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8240d973-a8c6-4622-9757-1caf2a42bdd2 with Priority: HIGHEST for action port [ 840.850778] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8240d973-a8c6-4622-9757-1caf2a42bdd2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.851663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8240d973-a8c6-4622-9757-1caf2a42bdd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.851781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8240d973-a8c6-4622-9757-1caf2a42bdd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.852096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8240d973-a8c6-4622-9757-1caf2a42bdd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.852209] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8240d973-a8c6-4622-9757-1caf2a42bdd2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.318749] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9530d1f3-ea46-423f-938d-224c9f8440e6 [ 841.319375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.319375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.319375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.319605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.319605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.319725] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9530d1f3-ea46-423f-938d-224c9f8440e6 already deleted. [ 841.319808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9530d1f3-ea46-423f-938d-224c9f8440e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.354317] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8240d973-a8c6-4622-9757-1caf2a42bdd2 [ 841.354650] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.354794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.354859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.355310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.355310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.355310] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8240d973-a8c6-4622-9757-1caf2a42bdd2 already deleted. [ 841.355427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8240d973-a8c6-4622-9757-1caf2a42bdd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.330358] env[69728]: INFO networking_nsxv3.common.synchronization [None req-0e01357b-e776-4f45-b0df-8eb1972af77a None None] Enqueued Resource ID: bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb with Priority: HIGHEST for action port [ 843.330674] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb with Priority: HIGHEST for action port [ 843.331551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.331680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.331750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.332016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.337437] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.840938] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb [ 843.841202] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.841339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.841411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.841620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.841713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.841814] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb already deleted. [ 843.841897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc28beaf-9aaf-46ee-ae3b-6f2f1cb91cfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.013045] env[69728]: INFO networking_nsxv3.common.synchronization [req-15e21568-fe59-48b5-8632-2577e9aa10a7 req-d8c1d8a9-c995-410b-941d-7611c2302511 tempest-ListServerFiltersTestJSON-1638024464 tempest-ListServerFiltersTestJSON-1638024464-project-member] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 844.013615] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 844.013917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.015097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.015201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.015402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.015560] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.015663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.015730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.015910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.016339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.016339] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.518293] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.563434] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.563628] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.563889] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.565397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.565397] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.565397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.565397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.565397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.565397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.565397] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.565397] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.565397] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.565397] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.565933] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.565933] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.565933] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.584814] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.584968] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.585122] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.585290] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.585598] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.585758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.587109] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.587109] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.587109] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.027554] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.093237] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.093237] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d not found, creating... [ 845.093237] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.093237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.093700] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.094405] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.094673] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.095254] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.095507] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.095747] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d is going to be created. [ 845.120333] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.120333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.120333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.120333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.120333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.120333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.485633] env[69728]: INFO networking_nsxv3.common.synchronization [None req-20b1ee00-12f6-43a6-8e2e-0844107f1e13 None None] Enqueued Resource ID: c10ff512-aef3-43c7-8688-92211eab841f with Priority: HIGHEST for action port [ 845.486492] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c10ff512-aef3-43c7-8688-92211eab841f with Priority: HIGHEST for action port [ 845.486492] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c10ff512-aef3-43c7-8688-92211eab841f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.486492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c10ff512-aef3-43c7-8688-92211eab841f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.486641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c10ff512-aef3-43c7-8688-92211eab841f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.486941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c10ff512-aef3-43c7-8688-92211eab841f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.489013] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c10ff512-aef3-43c7-8688-92211eab841f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.533354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.533354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.533354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.533354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.533354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.533354] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 845.560510] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.560510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.560510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.560510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.560510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.567906] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 845.782020] env[69728]: INFO networking_nsxv3.common.synchronization [req-7c4b8af9-a1cc-4021-af32-185f84509002 req-7c048a13-a627-449b-90ce-599951964075 tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 845.782020] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 845.782020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.782020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.782020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.782020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.782020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.782020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.782020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.782706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.782910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.783115] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.992505] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c10ff512-aef3-43c7-8688-92211eab841f [ 845.992665] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.992808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.992991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.993137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.993233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.993346] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c10ff512-aef3-43c7-8688-92211eab841f already deleted. [ 845.993442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c10ff512-aef3-43c7-8688-92211eab841f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.244048] env[69728]: INFO networking_nsxv3.common.synchronization [req-2ebf9543-e99d-42e1-a264-6ac2b9a77479 req-772b116d-7ab9-4d1a-bc44-ff86e6a1152b tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 846.245791] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 846.246140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.246270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.246338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.246583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.246748] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.246847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.247263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.247263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.247263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.247263] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.286677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.286875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.287067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.287139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.308888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.309170] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.309294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.309360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.309592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.309676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.309767] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 846.338206] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.338346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.338416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.338625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.338759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.358800] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 846.453256] env[69728]: INFO networking_nsxv3.common.synchronization [req-15e21568-fe59-48b5-8632-2577e9aa10a7 req-710cbd82-6e97-412b-b47e-a29ce95297a4 service nova] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_rules [ 846.453434] env[69728]: INFO networking_nsxv3.common.synchronization [req-15e21568-fe59-48b5-8632-2577e9aa10a7 req-710cbd82-6e97-412b-b47e-a29ce95297a4 service nova] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 846.453571] env[69728]: INFO networking_nsxv3.common.synchronization [req-15e21568-fe59-48b5-8632-2577e9aa10a7 req-710cbd82-6e97-412b-b47e-a29ce95297a4 service nova] Enqueued Resource ID: 6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d with Priority: HIGHEST for action port [ 846.453805] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_rules [ 846.453925] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 846.454082] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d with Priority: HIGHEST for action port [ 846.454669] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.454826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.454898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.455128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.455216] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.456068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.456171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.456360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.456458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.456524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.456708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.456788] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.725418] env[69728]: INFO networking_nsxv3.common.synchronization [req-70c720c0-747d-4a41-bf01-747c3599efa9 req-8f04e0a8-8cc9-49c8-843b-a29fc9ec63a1 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 846.725926] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 846.726237] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.726360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.726428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.726627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.726774] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.726872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.726934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.727093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.727184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.727529] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.750115] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.750300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.750408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.750698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.771718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.772008] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.772130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.772198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.772388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.772475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.772582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be updated. [ 846.796458] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.796596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.796674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.796862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.796994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.805867] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: IN_PROGRESS for 2s [ 846.958087] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.958225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.959610] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d with status ACTIVE [ 846.959805] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.959917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.959985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.960210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.960302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.960474] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.960641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.960641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.960957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.961061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.961253] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.961347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.961409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.961553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.961637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.961711] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d is going to be updated. [ 846.984235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.984373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.984444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.984641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.984773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.984931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f3befe1-3d89-4ccc-9e4b-2dc6dc9f3c1d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.230809] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.230940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.231468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.231468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.253537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.253780] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.253912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.253996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.254281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.254281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.254511] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 847.277347] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.277505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.278319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.278797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.278797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.288185] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 847.354440] env[69728]: INFO networking_nsxv3.common.synchronization [None req-af02886d-2de3-4e6f-85ff-454be434e295 None None] Enqueued Resource ID: 0ce620c5-1469-4a11-890d-a3fff37459d7 with Priority: HIGHEST for action port [ 847.354440] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce620c5-1469-4a11-890d-a3fff37459d7 with Priority: HIGHEST for action port [ 847.354440] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ce620c5-1469-4a11-890d-a3fff37459d7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.354440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ce620c5-1469-4a11-890d-a3fff37459d7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.354440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ce620c5-1469-4a11-890d-a3fff37459d7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.358470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ce620c5-1469-4a11-890d-a3fff37459d7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.358573] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ce620c5-1469-4a11-890d-a3fff37459d7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.576783] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 847.577032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.577199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.577424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.577620] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.577767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.577808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.577945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.578045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.578143] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.660319] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e6e7c49f-1c74-4b7d-b373-df3e75ccd4d5 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_rules [ 847.660841] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_rules [ 847.661163] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.661289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.661357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.661770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.661770] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.830380] env[69728]: INFO networking_nsxv3.common.synchronization [None req-8730935c-6092-4567-8db5-14b8081fe0a6 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_rules [ 847.830380] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_rules [ 847.830380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.831147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.865827] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ce620c5-1469-4a11-890d-a3fff37459d7 [ 847.866069] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.866201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.866269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.867018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.867258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.867464] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ce620c5-1469-4a11-890d-a3fff37459d7 already deleted. [ 847.869063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ce620c5-1469-4a11-890d-a3fff37459d7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.080936] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.184510] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.185572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.185572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.185572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.185572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.185572] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 already deleted. [ 848.185572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.185891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.186073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.186161] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.369746] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 848.369746] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda deletion is rescheduled due to dependency. [ 848.369746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.584717] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.710282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.710455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.710502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.710791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.710924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.711037] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 already deleted. [ 848.711127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.815348] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: SUCCESS [ 848.815348] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 deletion is rescheduled due to dependency. [ 848.815348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.088860] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.089184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.089184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.089312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.090142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.090335] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 849.118368] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.118368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.118368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.118622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.118742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.128467] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 849.299118] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 849.299355] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 849.299518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.222896] env[69728]: INFO networking_nsxv3.common.synchronization [req-13f5e716-609f-47b8-ab2e-d7a78817cbb2 req-5423a129-e944-475e-87ba-1fa1e4bec68f tempest-ListServerFiltersTestJSON-1638024464 tempest-ListServerFiltersTestJSON-1638024464-project-member] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 850.223956] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 850.224521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.224797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.948417] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-278 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.948417] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.948417] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.948417] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.950390] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.950793] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.951067] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.951452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.951745] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.954091] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.954091] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.954091] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.954091] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.954091] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 850.954091] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.954091] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.980702] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.980702] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 850.980702] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.980702] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-278" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.980702] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-3cade6d0-e13e-4e9d-a913-648be43af803 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.980702] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.980702] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.980702] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.980702] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cade6d0-e13e-4e9d-a913-648be43af803',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.141048] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 4s [ 851.483498] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.483858] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.483904] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.484208] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.484356] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.484521] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 3cade6d0-e13e-4e9d-a913-648be43af803 not found, creating... [ 851.484805] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.484975] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.485104] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.485345] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.485496] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.485781] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.485947] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.489321] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.489631] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.491723] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.491723] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 3cade6d0-e13e-4e9d-a913-648be43af803 is going to be created. [ 851.510041] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.510041] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.510041] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.510041] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.510041] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.510338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.333875] env[69728]: INFO networking_nsxv3.common.synchronization [req-13f5e716-609f-47b8-ab2e-d7a78817cbb2 req-73511637-3959-413d-a80a-5ca6a63a0052 service nova] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_rules [ 852.333875] env[69728]: INFO networking_nsxv3.common.synchronization [req-13f5e716-609f-47b8-ab2e-d7a78817cbb2 req-73511637-3959-413d-a80a-5ca6a63a0052 service nova] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 852.333875] env[69728]: INFO networking_nsxv3.common.synchronization [req-13f5e716-609f-47b8-ab2e-d7a78817cbb2 req-73511637-3959-413d-a80a-5ca6a63a0052 service nova] Enqueued Resource ID: 3cade6d0-e13e-4e9d-a913-648be43af803 with Priority: HIGHEST for action port [ 852.333875] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_rules [ 852.335227] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 852.335321] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cade6d0-e13e-4e9d-a913-648be43af803 with Priority: HIGHEST for action port [ 852.335625] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.335957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.335957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.336787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.336787] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cade6d0-e13e-4e9d-a913-648be43af803 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.336787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.336787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.336787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.336787] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cade6d0-e13e-4e9d-a913-648be43af803',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.838840] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cade6d0-e13e-4e9d-a913-648be43af803 with status ACTIVE [ 852.839146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.839227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.839276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.839486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.839576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.839823] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.839925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.839982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.840148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.840227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.840411] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.840738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.840738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.840738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.840887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.840961] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cade6d0-e13e-4e9d-a913-648be43af803 is going to be updated. [ 852.859789] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.860009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.860099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.860336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.860452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.860632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cade6d0-e13e-4e9d-a913-648be43af803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.153177] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 853.153954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.153954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.153954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.154152] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.154266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.154376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.154571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.156035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.156035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.156035] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.156035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.158720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.158940] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.159074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.159143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.159297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.159533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.159533] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.646754] env[69728]: INFO networking_nsxv3.common.synchronization [None req-eda357a2-6e69-4c7d-9620-bffc5714a763 None None] Enqueued Resource ID: 2b5fa33d-5839-44b8-8ac8-e4d4247671ae with Priority: HIGHEST for action port [ 853.647105] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5fa33d-5839-44b8-8ac8-e4d4247671ae with Priority: HIGHEST for action port [ 853.647718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5fa33d-5839-44b8-8ac8-e4d4247671ae taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.647850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5fa33d-5839-44b8-8ac8-e4d4247671ae" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.647920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5fa33d-5839-44b8-8ac8-e4d4247671ae" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.651434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5fa33d-5839-44b8-8ac8-e4d4247671ae" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.651570] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5fa33d-5839-44b8-8ac8-e4d4247671ae',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.661599] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.661726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.666537] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.153680] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b5fa33d-5839-44b8-8ac8-e4d4247671ae [ 854.154984] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.155193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.157032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.157032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.157032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.157032] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b5fa33d-5839-44b8-8ac8-e4d4247671ae already deleted. [ 854.157032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5fa33d-5839-44b8-8ac8-e4d4247671ae" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.173059] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.675250] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.675432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.675517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.675750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.675843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.675938] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 854.702731] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.702873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.702942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.703209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.703357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.711456] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 855.339363] env[69728]: INFO networking_nsxv3.common.synchronization [req-458330db-21d2-44f6-aedb-99e80609e5f0 req-226414ed-9a94-4857-ab71-e77b1fdf9908 tempest-ServersNegativeTestJSON-132698298 tempest-ServersNegativeTestJSON-132698298-project-member] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 855.339953] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 855.340621] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.340746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.340839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.342328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.343204] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.343204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.343204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.343204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.343204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.343643] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.845776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.846027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.846147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.846577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.846577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.846831] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.846969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.847065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.847259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.847363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.847566] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 already deleted. [ 855.847566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.980786] env[69728]: INFO networking_nsxv3.common.synchronization [None req-81dcbfc6-35f8-41c9-8d36-8f1806bac2dc None None] Enqueued Resource ID: b31bc1e9-7c4e-407f-a5fe-2f1489f99d93 with Priority: HIGHEST for action port [ 855.981060] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bc1e9-7c4e-407f-a5fe-2f1489f99d93 with Priority: HIGHEST for action port [ 855.981605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b31bc1e9-7c4e-407f-a5fe-2f1489f99d93 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.981731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b31bc1e9-7c4e-407f-a5fe-2f1489f99d93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.981781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b31bc1e9-7c4e-407f-a5fe-2f1489f99d93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.982707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b31bc1e9-7c4e-407f-a5fe-2f1489f99d93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.982897] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b31bc1e9-7c4e-407f-a5fe-2f1489f99d93',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.216310] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.216537] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.216708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.217081] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.217394] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.217563] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.217709] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.217980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.218154] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.218383] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.218529] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.218649] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.218768] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.218908] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 856.219046] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.219186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.241490] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.241658] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 856.241799] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.241980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.242378] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-ad4ed4ce-4479-4261-9a85-d42c2d139180 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.242564] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.242687] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.243095] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.243749] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4ed4ce-4479-4261-9a85-d42c2d139180',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.485517] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b31bc1e9-7c4e-407f-a5fe-2f1489f99d93 [ 856.486169] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.486169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.486169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.486574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.486574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.486574] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b31bc1e9-7c4e-407f-a5fe-2f1489f99d93 already deleted. [ 856.486574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b31bc1e9-7c4e-407f-a5fe-2f1489f99d93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.721211] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 856.721474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.721710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.721949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.722221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.722362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.722491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.723168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.723168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.723168] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.747039] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.747318] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.747471] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.747853] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.747949] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.748136] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port ad4ed4ce-4479-4261-9a85-d42c2d139180 not found, creating... [ 856.748449] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.748956] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.748956] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.749187] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.749187] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.749501] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.749732] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.749832] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.750082] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.750254] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.750416] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 is going to be created. [ 856.769223] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.769223] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.769223] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.769223] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.769500] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.769721] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.225283] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.621161] env[69728]: INFO networking_nsxv3.common.synchronization [req-458330db-21d2-44f6-aedb-99e80609e5f0 req-b7e70d75-b7e5-4127-9223-7d430bdde8ff service nova] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_rules [ 857.621544] env[69728]: INFO networking_nsxv3.common.synchronization [req-458330db-21d2-44f6-aedb-99e80609e5f0 req-b7e70d75-b7e5-4127-9223-7d430bdde8ff service nova] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 857.621714] env[69728]: INFO networking_nsxv3.common.synchronization [req-458330db-21d2-44f6-aedb-99e80609e5f0 req-b7e70d75-b7e5-4127-9223-7d430bdde8ff service nova] Enqueued Resource ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 with Priority: HIGHEST for action port [ 857.672272] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_rules [ 857.672272] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 857.672272] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 with Priority: HIGHEST for action port [ 857.672272] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.672272] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.672272] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.672272] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.672272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.672272] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.672272] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad4ed4ce-4479-4261-9a85-d42c2d139180 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.675989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.675989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.675989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.675989] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4ed4ce-4479-4261-9a85-d42c2d139180',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.732277] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.023148] env[69728]: INFO networking_nsxv3.common.synchronization [req-e96ab9c2-2dbb-4464-87b4-cb5c6c3ff4e2 req-938d4e56-a9eb-482c-92f7-7a96d96e292a tempest-ServersV294TestFqdnHostnames-1182635706 tempest-ServersV294TestFqdnHostnames-1182635706-project-member] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_members [ 858.023208] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_members [ 858.023520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.023647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.023714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.023974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.024156] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.024259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.024325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.024483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.024570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.024665] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.129764] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.129919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.133296] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.138730] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad4ed4ce-4479-4261-9a85-d42c2d139180 with status ACTIVE [ 858.138934] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.139068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.139136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.139349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.139439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.139615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.139736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.140048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.140689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.140809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.141148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.141270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.141336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.141490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.141571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.141657] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 is going to be updated. [ 858.162888] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.162999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.163087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.163290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.163426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.163581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.236557] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.236557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.236557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.236557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.236557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.236557] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 858.262785] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.262945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.263034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.263258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.263406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.281022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 858.526791] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.526949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.527038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.527286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.527444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.530375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.530375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.530375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.530375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.530375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.530375] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 already deleted. [ 858.530375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.550892] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-146 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.551109] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-146" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.551240] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-146" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.551560] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-146" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.551840] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.552010] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.552142] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.552365] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.552510] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.552727] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.552841] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.552948] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.553068] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.553177] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 858.553281] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.553414] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.571149] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.571363] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 858.571511] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.571689] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-146" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.572052] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.572249] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.572376] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.573335] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.573618] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.637131] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.076555] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.076924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.076924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.077267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.077526] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.077526] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b not found, creating... [ 859.077868] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.077961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.078008] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.078525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.078525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.078691] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.078805] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.078923] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.079194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.079754] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.079754] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b is going to be created. [ 859.101392] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.101571] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.101697] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.101959] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.102211] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.102430] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.140477] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.140714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.140804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.141105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.141193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.141359] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be created. [ 859.169201] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.169333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.169400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.169997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.169997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.184665] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: UNINITIALIZED for 2s [ 859.976396] env[69728]: INFO networking_nsxv3.common.synchronization [req-e96ab9c2-2dbb-4464-87b4-cb5c6c3ff4e2 req-2afa63df-5ce0-4221-8d7e-deb676e7f9c4 service nova] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_rules [ 859.976396] env[69728]: INFO networking_nsxv3.common.synchronization [req-e96ab9c2-2dbb-4464-87b4-cb5c6c3ff4e2 req-2afa63df-5ce0-4221-8d7e-deb676e7f9c4 service nova] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_members [ 859.976396] env[69728]: INFO networking_nsxv3.common.synchronization [req-e96ab9c2-2dbb-4464-87b4-cb5c6c3ff4e2 req-2afa63df-5ce0-4221-8d7e-deb676e7f9c4 service nova] Enqueued Resource ID: 94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b with Priority: HIGHEST for action port [ 859.976824] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_rules [ 859.976824] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_members [ 859.977481] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b with Priority: HIGHEST for action port [ 859.978040] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.978189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.978303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.978676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.979167] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.981081] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.983081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.983158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.983414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.983612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.983754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.983852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.984076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.984171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.984265] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.985079] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.985196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.985261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.985434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.985542] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.287337] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 860.287565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.287779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.288016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.288195] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.288314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.288380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.288534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.288620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.288705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.288866] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.288977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.289054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.289200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.289348] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.289441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.289502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.289639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.289714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.289819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.289915] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.486890] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.489866] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.490039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.490312] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b with status ACTIVE [ 860.490529] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.490672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.490746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.491055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.491249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.491482] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.491589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.491670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.491890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.491984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.493280] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.493432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.493503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.493630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.493707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.493796] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b is going to be updated. [ 860.516143] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.516308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.516442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.516658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.516794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.516964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94bca9dc-bcf4-48ba-b6e7-15e2293e5c7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.777979] env[69728]: INFO networking_nsxv3.common.synchronization [req-2e3b3db1-cb09-4b2e-9deb-1a8165c284d7 req-01c3563d-8fad-44bb-926d-beec2c4ff114 tempest-FloatingIPsAssociationTestJSON-1968110794 tempest-FloatingIPsAssociationTestJSON-1968110794-project-member] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 860.778537] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 860.778841] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.778965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.781888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.781888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.781888] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.781888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.781888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.781888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.781888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.782119] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.792231] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69ded0e1-c75f-440b-abf9-1fb132e0a59a: rpc.has_security_group_logging(os_id): False [ 860.812162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.812549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.812727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.813040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.831469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.832018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.832183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.832533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.832777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.832903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.833166] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.833671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.833770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.834362] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.834492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.834583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.834762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.834871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.834980] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 860.892580] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.892742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.892782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.893419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.894473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.906501] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 860.999435] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.060156] env[69728]: INFO networking_nsxv3.common.synchronization [None req-59ad590b-5c4c-4b3d-8c0c-8cb2b86040df None None] Enqueued Resource ID: aa4692d9-67f6-4f5d-ae7a-2841b85699fd with Priority: HIGHEST for action port [ 861.060197] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4692d9-67f6-4f5d-ae7a-2841b85699fd with Priority: HIGHEST for action port [ 861.060725] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4692d9-67f6-4f5d-ae7a-2841b85699fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.060908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4692d9-67f6-4f5d-ae7a-2841b85699fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.060987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4692d9-67f6-4f5d-ae7a-2841b85699fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.061738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4692d9-67f6-4f5d-ae7a-2841b85699fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.062235] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4692d9-67f6-4f5d-ae7a-2841b85699fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.193578] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 861.193819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.194244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.194507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.194551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.194781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.194781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.194976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.195217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.195217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.195217] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.284033] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.361192] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-195 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.365619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.365619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.365619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.365619] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.365619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.365976] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.366340] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.366587] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.366881] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.367090] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.367276] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.367485] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.367676] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.367853] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.368080] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.387613] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.390019] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.390019] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.390019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-195" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.390019] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-151ef66b-13b3-4755-a7cd-353b82e62383 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.390019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.390019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.390019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.390019] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151ef66b-13b3-4755-a7cd-353b82e62383',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.503488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.503641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.503684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.503937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.504051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.504158] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 is going to be created. [ 861.530495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.530738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.530847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.531105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.531268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.542955] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: UNINITIALIZED for 2s [ 861.564872] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa4692d9-67f6-4f5d-ae7a-2841b85699fd [ 861.565135] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.565272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.565344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.565559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.565649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.565743] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa4692d9-67f6-4f5d-ae7a-2841b85699fd already deleted. [ 861.565824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4692d9-67f6-4f5d-ae7a-2841b85699fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.701304] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.701437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.701462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.701868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.702056] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.702174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.702237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.702390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.702479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.703232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.703432] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.703545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.703620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.703966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.704140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.704272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.704331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.704446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.704531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.704615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.704703] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.786067] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.894690] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.894926] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.895078] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.897044] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 151ef66b-13b3-4755-a7cd-353b82e62383 not found, creating... [ 861.897044] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.897044] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.897044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.897942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.897942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.897942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.897942] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 151ef66b-13b3-4755-a7cd-353b82e62383 is going to be created. [ 861.922243] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.922475] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.922595] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.922875] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.923958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.923958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.209407] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15661f32-f427-4619-97c6-f59aec12ec77: rpc.has_security_group_logging(os_id): False [ 862.228613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.228806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.228885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.230107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.230107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.230107] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.230107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.230107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.230107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.230107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.232203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.232203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.232203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.232203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.232203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.232203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.232203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.232203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.235820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.235820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.235820] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be created. [ 862.288768] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.289071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.289220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.290030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.290030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.290030] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be updated. [ 862.296059] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.296224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.296291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.298675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.298675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.309596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 862.328443] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.328443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.328443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.328443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.328443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.335725] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: IN_PROGRESS for 2s [ 862.927589] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 862.927880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.928087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.928307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.928400] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.337148] env[69728]: INFO networking_nsxv3.common.synchronization [None req-76aae7ce-c01b-4bd8-aa5f-58c0c1719007 None None] Enqueued Resource ID: 1ba6d53e-dfc1-4435-a625-d4a2ac060e4d with Priority: HIGHEST for action port [ 863.337148] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ba6d53e-dfc1-4435-a625-d4a2ac060e4d with Priority: HIGHEST for action port [ 863.337148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ba6d53e-dfc1-4435-a625-d4a2ac060e4d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.337148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ba6d53e-dfc1-4435-a625-d4a2ac060e4d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.337148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ba6d53e-dfc1-4435-a625-d4a2ac060e4d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.337148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ba6d53e-dfc1-4435-a625-d4a2ac060e4d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.337148] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ba6d53e-dfc1-4435-a625-d4a2ac060e4d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.391982] env[69728]: INFO networking_nsxv3.common.synchronization [req-2e3b3db1-cb09-4b2e-9deb-1a8165c284d7 req-33002554-9a46-4273-9016-e0543e39ef68 service nova] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_rules [ 863.391982] env[69728]: INFO networking_nsxv3.common.synchronization [req-2e3b3db1-cb09-4b2e-9deb-1a8165c284d7 req-33002554-9a46-4273-9016-e0543e39ef68 service nova] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 863.391982] env[69728]: INFO networking_nsxv3.common.synchronization [req-2e3b3db1-cb09-4b2e-9deb-1a8165c284d7 req-33002554-9a46-4273-9016-e0543e39ef68 service nova] Enqueued Resource ID: 151ef66b-13b3-4755-a7cd-353b82e62383 with Priority: HIGHEST for action port [ 863.391982] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_rules [ 863.391982] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 863.391982] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 151ef66b-13b3-4755-a7cd-353b82e62383 with Priority: HIGHEST for action port [ 863.391982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.391982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.391982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.391982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.393057] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.394066] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.394290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.394634] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-151ef66b-13b3-4755-a7cd-353b82e62383 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.394863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.395025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.395280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.395439] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('151ef66b-13b3-4755-a7cd-353b82e62383',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.433470] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.433470] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.433470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.433470] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.552689] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: SUCCESS [ 863.552912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.553092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.553313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.553510] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.553623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.553686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.553862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.553952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.554295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.554388] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.840017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ba6d53e-dfc1-4435-a625-d4a2ac060e4d [ 863.840260] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.840393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.840466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.840668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.840749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.840862] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ba6d53e-dfc1-4435-a625-d4a2ac060e4d already deleted. [ 863.841073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ba6d53e-dfc1-4435-a625-d4a2ac060e4d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.897254] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 151ef66b-13b3-4755-a7cd-353b82e62383 with status ACTIVE [ 863.897483] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.897616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.897686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.897945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.898054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.898243] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.898345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.898408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.898564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.898641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.898823] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.898917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.898995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.899151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.899227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.899312] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 151ef66b-13b3-4755-a7cd-353b82e62383 is going to be updated. [ 863.901199] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.901199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.925246] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.925246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.925246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.925246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.925246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.925246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-151ef66b-13b3-4755-a7cd-353b82e62383" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.934595] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.934724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.934805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.935061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.935227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.935358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.935421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.935573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.935663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.935766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.935927] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.936018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.936080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.936247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.936386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.936475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.936535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.936714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.936790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.936879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.936979] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.057896] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.269125] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 864.269125] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:1 started [ 864.320666] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 864.320666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.346514] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.346514] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.346514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.346514] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.440903] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69ded0e1-c75f-440b-abf9-1fb132e0a59a: rpc.has_security_group_logging(os_id): False [ 864.458466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.458466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.458466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.458466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.458869] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.458869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.458869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.458869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.459362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.459596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 864.528753] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.528909] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.528981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.529213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.529365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.542343] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 864.559488] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 843812e4-7adf-4d17-bf4b-07d845b47f68: rpc.has_security_group_logging(os_id): False [ 864.590095] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.592243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.592351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.592591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.592682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.592938] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.593055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.593121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.593272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.593349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.593436] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 is going to be created. [ 864.668090] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.668255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.668328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.668537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.668717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.678885] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: IN_PROGRESS for 2s [ 864.851876] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.353897] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.856459] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.856683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.856765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.857032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.857152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.857263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be updated. [ 865.886402] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.886543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.886611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.886826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.887263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.895458] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: IN_PROGRESS for 2s [ 866.557662] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 866.557662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.697186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: SUCCESS [ 866.697439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.887337] env[69728]: INFO networking_nsxv3.common.synchronization [req-4c8ff68e-e21f-406f-868c-640460d38330 req-a0660e0d-a0a3-4a25-b5f3-823b5bded180 tempest-VolumesAssistedSnapshotsTest-955716078 tempest-VolumesAssistedSnapshotsTest-955716078-project-member] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_members [ 866.891025] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGHEST for action security_group_members [ 866.891025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.891025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.891025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.891025] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.394814] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.395284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.395419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.395739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.416930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.417452] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.417979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.417979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.417979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.418125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.418256] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb is going to be updated. [ 867.443671] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.443671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.444147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.444436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.445051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.452999] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 875b1121-9a68-45f5-9b21-ff23d886dadb in Status: IN_PROGRESS for 2s [ 867.561854] env[69728]: INFO networking_nsxv3.common.synchronization [req-84ffcb17-95c4-476b-9c87-45c5e217527a req-16db8cf5-51a6-4b41-ac92-c1c260bdc6fb tempest-ListImageFiltersTestJSON-1392908584 tempest-ListImageFiltersTestJSON-1392908584-project-member] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 867.562416] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 867.562723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.562848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.563122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.563280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.563348] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.563451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.563513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.563664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.563836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.563836] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.905682] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 867.905682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.905682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.905682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.905981] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.905981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.905981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.906156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.906271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.906390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.906443] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.065719] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.065943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.065943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.066301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.066405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.066627] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.066733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.066819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.067018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.067133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.067228] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a already deleted. [ 868.067321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.409568] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.409729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.409729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.409990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.410209] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.410379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.410379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.410552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.410653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.410743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.411032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.411032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.411140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.411223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.411365] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.411547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.411547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.411689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.412070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.412070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.412070] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.419496] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.419649] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.419797] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.420092] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.420596] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.420596] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.420596] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.420810] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.420958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.421172] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.422709] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.422709] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.422709] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.422709] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.422709] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.422709] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.439396] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.439592] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.439783] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.440028] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.440364] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-4a05e453-f243-46a1-9ebd-1c81c2843b72 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.440567] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.440693] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.441039] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.441191] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a05e453-f243-46a1-9ebd-1c81c2843b72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.913947] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd5fc210-b40b-42fd-9bcf-e190a117ea03: rpc.has_security_group_logging(os_id): False [ 868.944183] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.944456] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.944630] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.944956] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.945162] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.945336] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 4a05e453-f243-46a1-9ebd-1c81c2843b72 not found, creating... [ 868.945695] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.945958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.946141] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.946432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.946580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.946869] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.947053] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.947136] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.947358] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.947489] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.947699] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 4a05e453-f243-46a1-9ebd-1c81c2843b72 is going to be created. [ 868.968093] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.968346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.968493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.968935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.987204] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.987454] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.987621] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.987936] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.988213] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.988513] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.992985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.993250] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.993384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.993468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.993674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.993757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.993985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.994119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.994188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.994361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.994444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998014] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.998157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.998248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.998433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.998569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998664] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be updated. [ 869.110736] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.111018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.111018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.112437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.112437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.130596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: IN_PROGRESS for 2s [ 869.465624] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 875b1121-9a68-45f5-9b21-ff23d886dadb in Status: SUCCESS [ 869.465624] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb deletion is rescheduled due to dependency. [ 869.465624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.131239] env[69728]: INFO networking_nsxv3.common.synchronization [req-84ffcb17-95c4-476b-9c87-45c5e217527a req-41f73bb5-264f-4272-9648-72cb8cc1a59a service nova] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_rules [ 870.131239] env[69728]: INFO networking_nsxv3.common.synchronization [req-84ffcb17-95c4-476b-9c87-45c5e217527a req-41f73bb5-264f-4272-9648-72cb8cc1a59a service nova] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 870.131239] env[69728]: INFO networking_nsxv3.common.synchronization [req-84ffcb17-95c4-476b-9c87-45c5e217527a req-41f73bb5-264f-4272-9648-72cb8cc1a59a service nova] Enqueued Resource ID: 4a05e453-f243-46a1-9ebd-1c81c2843b72 with Priority: HIGHEST for action port [ 870.131239] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_rules [ 870.131239] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 870.131239] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a05e453-f243-46a1-9ebd-1c81c2843b72 with Priority: HIGHEST for action port [ 870.131239] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.131239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.131239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.131693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.131693] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.132448] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.132573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.132619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.132799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.132937] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.133035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.133094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.133230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.133319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.133404] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.134136] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a05e453-f243-46a1-9ebd-1c81c2843b72 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.134240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.134300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.134447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.134544] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a05e453-f243-46a1-9ebd-1c81c2843b72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.231300] env[69728]: INFO networking_nsxv3.common.synchronization [req-bd166f7b-c4c2-4891-ae01-d14839767828 req-f377d43b-2615-4e8f-92aa-5e2bcdb2fc3b tempest-ListImageFiltersTestJSON-1392908584 tempest-ListImageFiltersTestJSON-1392908584-project-member] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 870.231798] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 870.232111] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.232893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.637303] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.639157] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.639436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.639657] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a05e453-f243-46a1-9ebd-1c81c2843b72 with status ACTIVE [ 870.640244] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.640244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.640244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.640453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.640513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.641021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.641021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.641021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.641021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.641865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.641865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.641865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.641865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.641865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.641865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.641865] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a05e453-f243-46a1-9ebd-1c81c2843b72 is going to be updated. [ 870.661019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.661183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.661252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.661474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.661614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.661771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a05e453-f243-46a1-9ebd-1c81c2843b72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.687180] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.687180] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.687180] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.687180] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.687180] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.690186] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.693758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.693758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.693758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.693758] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.693758] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.693758] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.693758] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.693758] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 870.693758] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.693758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.709395] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.709548] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 870.709683] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.709856] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.710191] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-57785a3f-1387-408b-9a0f-21cb54d03381 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.710393] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.710513] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.710899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.711054] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57785a3f-1387-408b-9a0f-21cb54d03381',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.140302] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.144670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 871.144938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.217413] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.217643] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.217778] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.218058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.218207] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.218363] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 57785a3f-1387-408b-9a0f-21cb54d03381 not found, creating... [ 871.218625] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.218781] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.218900] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.219633] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.220325] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.221237] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.221477] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.221717] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.222561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.222849] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.223503] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 57785a3f-1387-408b-9a0f-21cb54d03381 is going to be created. [ 871.244405] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.244650] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.244793] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.245105] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.245356] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.245618] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.643390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.643613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.643705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.643935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.644039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.644139] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be created. [ 871.666390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.666529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.666582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.666792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.666946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.675225] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: UNINITIALIZED for 2s [ 872.496091] env[69728]: INFO networking_nsxv3.common.synchronization [req-bd166f7b-c4c2-4891-ae01-d14839767828 req-eb24f03a-9d04-4e95-a249-f0f7554784ee service nova] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_rules [ 872.496346] env[69728]: INFO networking_nsxv3.common.synchronization [req-bd166f7b-c4c2-4891-ae01-d14839767828 req-eb24f03a-9d04-4e95-a249-f0f7554784ee service nova] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 872.497099] env[69728]: INFO networking_nsxv3.common.synchronization [req-bd166f7b-c4c2-4891-ae01-d14839767828 req-eb24f03a-9d04-4e95-a249-f0f7554784ee service nova] Enqueued Resource ID: 57785a3f-1387-408b-9a0f-21cb54d03381 with Priority: HIGHEST for action port [ 872.497099] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_rules [ 872.497099] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 872.497099] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57785a3f-1387-408b-9a0f-21cb54d03381 with Priority: HIGHEST for action port [ 872.497624] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.497624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.497749] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.497794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.497956] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-57785a3f-1387-408b-9a0f-21cb54d03381 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.498245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.498358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.498583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.498670] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57785a3f-1387-408b-9a0f-21cb54d03381',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.000520] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57785a3f-1387-408b-9a0f-21cb54d03381 with status ACTIVE [ 873.000897] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.001162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.001304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.001524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.001665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.001935] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.002114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.002219] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.002432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.002549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.002820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.002967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.003082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.003295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.003419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.003548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57785a3f-1387-408b-9a0f-21cb54d03381 is going to be updated. [ 873.026187] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.026380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.026504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.026747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.026948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.027195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57785a3f-1387-408b-9a0f-21cb54d03381" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.686423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 873.686738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.687120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.688776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.688776] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.688776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.688776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.688776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.688776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.688776] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.192112] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.694943] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.197686] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.197877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.198148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.198406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.198538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.198648] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be updated. [ 875.225189] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.225461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.225461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.225691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.225866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.239105] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: IN_PROGRESS for 2s [ 877.251553] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 877.251939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.252032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.252393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.252665] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.252849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.252911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.253082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.253174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.253461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.253461] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.255891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.256159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.256449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.256604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.256703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.256882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.256969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.257105] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.499896] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 877.499896] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 877.757325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.757461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.762937] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.105182] env[69728]: INFO networking_nsxv3.common.synchronization [None req-4ce2cd04-1b7f-417c-bf4f-036e592bfa0f tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_rules [ 878.105182] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_rules [ 878.105182] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.105182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.105182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.105457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.105595] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.194709] env[69728]: INFO networking_nsxv3.common.synchronization [None req-0154a195-b3ad-4356-ab42-fdd56b506f4c tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_rules [ 878.195697] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_rules [ 878.195742] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.195849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.264900] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.630892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.631102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.631219] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.631396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.631500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.631626] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 already deleted. [ 878.631720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.632076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.632244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.632329] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.768007] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.768296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.768368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.768585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.768679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.768782] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be updated. [ 878.793272] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.793448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.793509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.793670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.793811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.801420] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: IN_PROGRESS for 2s [ 879.156188] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.156364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.156428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.156610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.156710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.156810] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 already deleted. [ 879.156896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.620520] env[69728]: INFO networking_nsxv3.common.synchronization [None req-d2b7cc21-cd1b-4ccf-a168-5f00ed662ec2 None None] Enqueued Resource ID: 4b3b7634-36b6-4c67-bfd2-363d0ed5d40d with Priority: HIGHEST for action port [ 880.620920] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b3b7634-36b6-4c67-bfd2-363d0ed5d40d with Priority: HIGHEST for action port [ 880.621250] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b3b7634-36b6-4c67-bfd2-363d0ed5d40d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.621508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b3b7634-36b6-4c67-bfd2-363d0ed5d40d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.621637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b3b7634-36b6-4c67-bfd2-363d0ed5d40d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.621912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b3b7634-36b6-4c67-bfd2-363d0ed5d40d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.622281] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b3b7634-36b6-4c67-bfd2-363d0ed5d40d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.811296] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 880.811614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.811686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.811932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.812183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.812341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.812416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.812629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.812725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.812821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.813035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.813146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.813210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.813382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.813524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.813617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.813678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.813816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.813893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.813977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.814332] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.124993] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b3b7634-36b6-4c67-bfd2-363d0ed5d40d [ 881.125326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.125504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.125601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.125845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.125970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.127582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b3b7634-36b6-4c67-bfd2-363d0ed5d40d already deleted. [ 881.128227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b3b7634-36b6-4c67-bfd2-363d0ed5d40d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.162729] env[69728]: INFO networking_nsxv3.common.synchronization [req-01b6a772-4a3c-4b2c-922f-c0f5926596fb req-301795c1-be2c-4e94-b123-b7b6678ded8a tempest-ServerMetadataNegativeTestJSON-387871590 tempest-ServerMetadataNegativeTestJSON-387871590-project-member] Enqueued Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_members [ 881.163354] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_members [ 881.163667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.163789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.163856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.164141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.164303] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.164404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.164465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.165120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.165120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.165120] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.318961] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2c67d4e-4d10-4e52-a09a-e7c33344cd7a: rpc.has_security_group_logging(os_id): False [ 881.336167] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.336167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.336167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.336310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.336310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.336508] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.336603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.336664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.336942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.336942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.337153] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.337262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.337320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.337497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.337588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.337746] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.337835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.337898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.338058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.338140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.338223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be created. [ 881.403959] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.404202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.404202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.404405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.404595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.414979] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: IN_PROGRESS for 2s [ 881.669855] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.670207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.670207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.670495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.670554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.672522] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.672642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.672710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.672892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.672976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.673103] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82d01262-c022-4809-a7a7-19f567af2ac0 already deleted. [ 881.673270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.513156] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-768 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.513357] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-768" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.513484] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-768" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.513895] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-768" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.514072] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.514233] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.514367] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.514598] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.514804] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.515049] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.515171] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.515283] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.515393] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.515504] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 882.515610] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.515744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.533351] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.533517] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 882.533656] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.533836] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-768" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.534158] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-6306bb6a-fe05-4465-95fd-7f15881b29e0 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.534331] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.534453] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.534748] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.534887] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6306bb6a-fe05-4465-95fd-7f15881b29e0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.953788] env[69728]: INFO networking_nsxv3.common.synchronization [req-ae9ac9e0-c250-47a0-aa58-9e687ea22a52 req-212d7cd9-e205-414f-9acf-c2076f3c8d59 tempest-FloatingIPsAssociationTestJSON-1968110794 tempest-FloatingIPsAssociationTestJSON-1968110794-project-member] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 882.955058] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 882.955058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.955058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.955058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.955058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.955290] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.955290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.955363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.955658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.955658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.955658] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.981922] env[69728]: INFO networking_nsxv3.common.synchronization [None req-fccd6281-d388-454b-819a-dce035c2f130 None None] Enqueued Resource ID: a9a6f89e-d9df-49cc-91c1-617d7b06c535 with Priority: HIGHEST for action port [ 882.981922] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a6f89e-d9df-49cc-91c1-617d7b06c535 with Priority: HIGHEST for action port [ 882.981922] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9a6f89e-d9df-49cc-91c1-617d7b06c535 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.981922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9a6f89e-d9df-49cc-91c1-617d7b06c535" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.981922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9a6f89e-d9df-49cc-91c1-617d7b06c535" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.981922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9a6f89e-d9df-49cc-91c1-617d7b06c535" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.981922] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9a6f89e-d9df-49cc-91c1-617d7b06c535',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.038475] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.039357] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.042686] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.045017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 6306bb6a-fe05-4465-95fd-7f15881b29e0 not found, creating... [ 883.045017] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.045017] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.045017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.045844] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.046173] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.046414] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.046672] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 6306bb6a-fe05-4465-95fd-7f15881b29e0 is going to be created. [ 883.067674] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.067868] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.067990] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.068900] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.068900] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.069417] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.429069] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 883.431487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.431487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.431487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.431579] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.462468] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.484962] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9a6f89e-d9df-49cc-91c1-617d7b06c535 [ 883.486305] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.486305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.486305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.486305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.486305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.486305] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9a6f89e-d9df-49cc-91c1-617d7b06c535 already deleted. [ 883.486305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9a6f89e-d9df-49cc-91c1-617d7b06c535" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.921941] env[69728]: INFO networking_nsxv3.common.synchronization [req-01b6a772-4a3c-4b2c-922f-c0f5926596fb req-94d0ef82-db6d-4e2d-9bb5-6b3426e139d0 service nova] Enqueued Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_rules [ 883.922166] env[69728]: INFO networking_nsxv3.common.synchronization [req-01b6a772-4a3c-4b2c-922f-c0f5926596fb req-94d0ef82-db6d-4e2d-9bb5-6b3426e139d0 service nova] Enqueued Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_members [ 883.922317] env[69728]: INFO networking_nsxv3.common.synchronization [req-01b6a772-4a3c-4b2c-922f-c0f5926596fb req-94d0ef82-db6d-4e2d-9bb5-6b3426e139d0 service nova] Enqueued Resource ID: 6306bb6a-fe05-4465-95fd-7f15881b29e0 with Priority: HIGHEST for action port [ 883.922596] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_rules [ 883.922711] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_members [ 883.922871] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6306bb6a-fe05-4465-95fd-7f15881b29e0 with Priority: HIGHEST for action port [ 883.923975] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.924200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.924336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.924622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.924760] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.925715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.926224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.926337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.927073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.927073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.927073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.927073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.927073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.927351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.927460] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.929171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6306bb6a-fe05-4465-95fd-7f15881b29e0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.929171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.929171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.929171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.929171] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6306bb6a-fe05-4465-95fd-7f15881b29e0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.934675] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.934811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.934878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.935139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.935398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.935494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.935594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.935765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.935873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.935984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.936106] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.964068] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.434488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.434625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.434833] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.435724] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6306bb6a-fe05-4465-95fd-7f15881b29e0 with status ACTIVE [ 884.435902] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.436131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.436131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.436272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.436361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.436524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.436695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.436695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.436827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.436872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.437058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.440586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.440586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.440586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.440785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.440785] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6306bb6a-fe05-4465-95fd-7f15881b29e0 is going to be updated. [ 884.442117] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.442280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.442280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.442436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.442600] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.442698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.442753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.442911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.442981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.443135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.443223] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.443315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.443364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.443546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.443699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.443790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.443853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.443983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.446482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.446585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.446810] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.466895] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.467098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.467159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.467584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.467584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.467715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6306bb6a-fe05-4465-95fd-7f15881b29e0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.467915] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.468028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.468159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.468262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.468367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.468558] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be updated. [ 884.507224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.507404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.507462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.507858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.507858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.529673] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: IN_PROGRESS for 2s [ 884.943293] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.951310] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2c67d4e-4d10-4e52-a09a-e7c33344cd7a: rpc.has_security_group_logging(os_id): False [ 884.967723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.967982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.967982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.968134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.968224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.968446] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.968548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.968740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.968740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.968826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.969397] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.969397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.969397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.969397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.969397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.969569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.969796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.969796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.969901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.969937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.970013] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be updated. [ 885.029400] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.029582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.029638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.029834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.029970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.040731] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: IN_PROGRESS for 2s [ 885.445773] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.446481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.446481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.446481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.446632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.447508] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82d01262-c022-4809-a7a7-19f567af2ac0 is going to be created. [ 885.470318] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.470318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.470318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.470318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.470318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.480050] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82d01262-c022-4809-a7a7-19f567af2ac0 in Status: UNINITIALIZED for 2s [ 886.092298] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6ac9e813-093e-44b4-8e29-d7f5a7e6e57b tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 2584b10f-90e1-427d-8483-dbb4dd6c4c93 with Priority: HIGHEST for action security_group_rules [ 886.093426] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2584b10f-90e1-427d-8483-dbb4dd6c4c93 with Priority: HIGHEST for action security_group_rules [ 886.093426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.093426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.093426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.093426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.094151] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2584b10f-90e1-427d-8483-dbb4dd6c4c93',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.168473] env[69728]: INFO networking_nsxv3.common.synchronization [None req-cde38e6e-b145-4a8b-b222-de504ee4dc64 tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 2584b10f-90e1-427d-8483-dbb4dd6c4c93 with Priority: HIGHEST for action security_group_rules [ 886.169040] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2584b10f-90e1-427d-8483-dbb4dd6c4c93 with Priority: HIGHEST for action security_group_rules [ 886.169437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.169574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.539842] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 886.540060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.614560] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.614769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.615181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.615181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.615181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.615574] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2584b10f-90e1-427d-8483-dbb4dd6c4c93 already deleted. [ 886.615574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.615574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.615574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.615921] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2584b10f-90e1-427d-8483-dbb4dd6c4c93',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.053817] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 887.054136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.146233] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.146503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.146503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.146656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.146746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.146837] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2584b10f-90e1-427d-8483-dbb4dd6c4c93 already deleted. [ 887.146917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2584b10f-90e1-427d-8483-dbb4dd6c4c93" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.374014] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c3a7ab7-40e2-4eda-b3d8-33ad852baf08 req-f6b8250f-7e75-4a81-bf8f-8899cbd96252 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 887.374197] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c3a7ab7-40e2-4eda-b3d8-33ad852baf08 req-f6b8250f-7e75-4a81-bf8f-8899cbd96252 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 887.374335] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c3a7ab7-40e2-4eda-b3d8-33ad852baf08 req-f6b8250f-7e75-4a81-bf8f-8899cbd96252 tempest-SecurityGroupsTestJSON-528547050 tempest-SecurityGroupsTestJSON-528547050-project-member] Enqueued Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_members [ 887.374840] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGHEST for action security_group_members [ 887.374975] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGHEST for action security_group_members [ 887.375085] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGHEST for action security_group_members [ 887.375358] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.375478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.375554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.375817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.376018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.376129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.376199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.376361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.376446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.376539] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.377417] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.377509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.377566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.377734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.377874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.377969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.378030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.378180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.378273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.378360] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.383662] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-447fcb82-2686-43bc-be85-02c4a3f9ea8f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.384405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.384405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.384405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.384405] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.384405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.384405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.384792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.384792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.384792] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.490828] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82d01262-c022-4809-a7a7-19f567af2ac0 in Status: SUCCESS [ 887.491072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.491244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.491473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.491769] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.491999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.492084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.492291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.492416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.492574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.492637] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.886607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.886760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.886835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.887061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.887155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.887360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.887483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.887584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.887668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.887745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.887833] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be updated. [ 887.889017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.889130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.889186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.889343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.890383] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.890469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.911526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.911770] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.911887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.911956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.912160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.912241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.912332] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be updated. [ 887.913291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.913464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.918244] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.918401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.918439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.918694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.918993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.927376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: IN_PROGRESS for 2s [ 887.939468] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.939625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.939685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.939908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.940067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.942979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.943325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.943449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.943516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.943765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.943854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.943986] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f is going to be updated. [ 887.947264] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: IN_PROGRESS for 2s [ 887.977055] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.977232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.977267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.977467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.977608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.985564] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: IN_PROGRESS for 2s [ 887.995107] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.995266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.995340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.995551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.995724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.995853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.995883] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.996028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.996115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.996197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.996347] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.996441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.996501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.996642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.996782] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.996913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.996940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.997087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.997180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.997240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.997332] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.215869] env[69728]: INFO networking_nsxv3.common.synchronization [req-cbde584d-ff9b-41be-861b-84d285a9389a req-2648c318-1d84-4749-843b-96649ad3a1b7 tempest-ListServerFiltersTestJSON-1638024464 tempest-ListServerFiltersTestJSON-1638024464-project-member] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 888.216438] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 888.216751] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.216874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.216941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.217770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.217941] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.218061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.218124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.218290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.218372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.218470] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.500186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82d01262-c022-4809-a7a7-19f567af2ac0: rpc.has_security_group_logging(os_id): False [ 888.517608] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.517843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.517931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.518218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.518336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.518573] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.518722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.518791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.518925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.519023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.519213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.519327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.519385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.519541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.519615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.519812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.519905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.519966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.520133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.520238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.520335] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82d01262-c022-4809-a7a7-19f567af2ac0 is going to be created. [ 888.577851] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.578016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.578157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.578421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.578614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.590052] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82d01262-c022-4809-a7a7-19f567af2ac0 in Status: IN_PROGRESS for 2s [ 888.721021] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.223559] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.597843] env[69728]: INFO networking_nsxv3.common.synchronization [None req-f4c214ae-48a0-4a9f-8c63-af8b2e69f991 tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_rules [ 889.598486] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_rules [ 889.598799] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.598913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.598977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.599394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.599480] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.702833] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a73b3cd1-8a9f-412f-b2fc-953b5b54f4eb tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_rules [ 889.703865] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_rules [ 889.703865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.703865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.727029] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.727391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.727518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.727824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.727973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.728117] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 889.759044] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.759044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.759044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.759044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.759044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.766565] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 889.939031] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 in Status: SUCCESS [ 889.939031] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 deletion is rescheduled due to dependency. [ 889.939031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.958625] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a in Status: SUCCESS [ 889.958625] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a deletion is rescheduled due to dependency. [ 889.958625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.992872] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f in Status: SUCCESS [ 889.993663] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f deletion is rescheduled due to dependency. [ 889.993663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.119116] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.119302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.119344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.119549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.119635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.119733] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 already deleted. [ 890.119844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.119969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.120143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.120285] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.602288] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82d01262-c022-4809-a7a7-19f567af2ac0 in Status: SUCCESS [ 890.602288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.639718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.639881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.639921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.640192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.640371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.640475] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 already deleted. [ 890.640575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.776618] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 891.776893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.633692] env[69728]: INFO networking_nsxv3.common.synchronization [req-b75b648d-8997-4643-a48e-50a6c9b3c3cf req-6121db9d-e148-413b-b7cc-a721788bd8b5 tempest-MigrationsAdminTest-770467406 tempest-MigrationsAdminTest-770467406-project-member] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 893.634255] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 893.634578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.634718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.634796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.637484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.637742] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.637857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.637966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.638141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.638265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.638369] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.069843] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-737 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.069843] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.070209] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.070536] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.070809] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.070992] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.071121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.071322] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.071508] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.071893] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.071893] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 894.072012] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 894.072070] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 894.072138] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 894.072392] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 894.072530] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 894.092556] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 894.092774] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 894.092927] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 894.093222] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-737" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.093470] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-7024359f-d55a-44bc-abed-731d8e59ebfb taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.093667] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.093809] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.094112] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.094268] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7024359f-d55a-44bc-abed-731d8e59ebfb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.141285] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.599898] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.599898] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.599898] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.599898] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.599898] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.599898] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 7024359f-d55a-44bc-abed-731d8e59ebfb not found, creating... [ 894.599898] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.600267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.600267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.600395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.600527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.600875] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.601053] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.601205] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.601459] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.601615] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.601789] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 7024359f-d55a-44bc-abed-731d8e59ebfb is going to be created. [ 894.634119] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.634119] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.634119] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.634518] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.634824] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.635734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.644118] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.146157] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.146331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.146404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.146631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.146720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.147020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be updated. [ 895.186355] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.186485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.186537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.186730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.186928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.195592] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: IN_PROGRESS for 2s [ 895.480170] env[69728]: INFO networking_nsxv3.common.synchronization [req-b75b648d-8997-4643-a48e-50a6c9b3c3cf req-95d80a09-1e58-4699-9ea4-81349392f340 service nova] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_rules [ 895.480170] env[69728]: INFO networking_nsxv3.common.synchronization [req-b75b648d-8997-4643-a48e-50a6c9b3c3cf req-95d80a09-1e58-4699-9ea4-81349392f340 service nova] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 895.480170] env[69728]: INFO networking_nsxv3.common.synchronization [req-b75b648d-8997-4643-a48e-50a6c9b3c3cf req-95d80a09-1e58-4699-9ea4-81349392f340 service nova] Enqueued Resource ID: 7024359f-d55a-44bc-abed-731d8e59ebfb with Priority: HIGHEST for action port [ 895.480170] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_rules [ 895.480170] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 895.480170] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7024359f-d55a-44bc-abed-731d8e59ebfb with Priority: HIGHEST for action port [ 895.480170] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.480170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.480170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.480170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.480170] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.481504] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.481780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.482099] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7024359f-d55a-44bc-abed-731d8e59ebfb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.482331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.482503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.482798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.482966] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7024359f-d55a-44bc-abed-731d8e59ebfb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.821532] env[69728]: INFO networking_nsxv3.common.synchronization [req-bc1a60c1-f634-4ec6-82e0-8710b10475a7 req-790f2d72-f48e-4050-ac9e-4b5aff65cedc tempest-ServerMetadataNegativeTestJSON-387871590 tempest-ServerMetadataNegativeTestJSON-387871590-project-member] Enqueued Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_members [ 895.822086] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d01262-c022-4809-a7a7-19f567af2ac0 with Priority: HIGHEST for action security_group_members [ 895.822398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-82d01262-c022-4809-a7a7-19f567af2ac0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.822527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.822594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.822791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.822941] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.823056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.823121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.823268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.823353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.823448] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82d01262-c022-4809-a7a7-19f567af2ac0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.985212] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.985212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.986706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7024359f-d55a-44bc-abed-731d8e59ebfb with status ACTIVE [ 895.986797] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.986921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.987058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.987291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.987387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.987598] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.987713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.987788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.987948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.988053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.988309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.988626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.988770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.988948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.989090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.989207] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7024359f-d55a-44bc-abed-731d8e59ebfb is going to be updated. [ 896.009016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.010187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.010187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.010187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.010187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.010187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7024359f-d55a-44bc-abed-731d8e59ebfb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.326051] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.326321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.326424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.326675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.326771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.326989] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.327148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.327255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.327414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.327508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.327596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82d01262-c022-4809-a7a7-19f567af2ac0 is going to be updated. [ 896.356012] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.356172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.356247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.356724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.356724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.362981] env[69728]: INFO networking_nsxv3.common.synchronization [req-04ab6bb0-e75f-45f7-8307-6e5a9e64feb7 req-407b6a33-8baf-4591-8fe1-d37c4be678e3 tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 896.363517] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 896.363823] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.363940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.364013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.364239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.364407] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.364499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.364561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.364707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.364790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.364885] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.368435] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82d01262-c022-4809-a7a7-19f567af2ac0 in Status: IN_PROGRESS for 2s [ 896.866807] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.867088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.867127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.867319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.886494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.886782] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.886904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.886971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.890087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.890087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.890087] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 896.912553] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.912697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.912768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.913022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.913163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.921186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 897.220275] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 897.220701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.220903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.221011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.221235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.221356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.221582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.221634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.221743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.221859] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.307014] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.307387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.307592] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.308125] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.308837] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.309204] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.309604] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.309959] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.310379] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.314101] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.314262] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.314397] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.314512] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.314628] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 897.314734] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.314889] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.335756] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.336053] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 897.336297] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.336537] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.336949] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c90f64fa-0e97-4b84-89db-6cfa33733412 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.337210] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.337384] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.337784] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.338006] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c90f64fa-0e97-4b84-89db-6cfa33733412',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.729152] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.841767] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.842019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.842160] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.842444] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.842591] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.842747] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c90f64fa-0e97-4b84-89db-6cfa33733412 not found, creating... [ 897.843014] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.843181] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.843297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.843511] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.843648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.844053] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.844219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.844334] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.844552] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.844688] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.844829] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c90f64fa-0e97-4b84-89db-6cfa33733412 is going to be created. [ 897.864407] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.864741] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.864741] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.864869] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.865110] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.865343] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.230650] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.377855] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82d01262-c022-4809-a7a7-19f567af2ac0 in Status: SUCCESS [ 898.378567] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82d01262-c022-4809-a7a7-19f567af2ac0 deletion is rescheduled due to dependency. [ 898.378692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82d01262-c022-4809-a7a7-19f567af2ac0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.734686] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.734832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.734891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.735350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.735350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.735350] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be updated. [ 898.765172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.765299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.765351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.765955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.765955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.776147] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: IN_PROGRESS for 2s [ 898.930681] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 898.930881] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 898.931014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.955829] env[69728]: INFO networking_nsxv3.common.synchronization [req-04ab6bb0-e75f-45f7-8307-6e5a9e64feb7 req-411051c1-19b9-4e69-90c1-5226a303be20 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 898.955829] env[69728]: INFO networking_nsxv3.common.synchronization [req-04ab6bb0-e75f-45f7-8307-6e5a9e64feb7 req-411051c1-19b9-4e69-90c1-5226a303be20 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 898.955829] env[69728]: INFO networking_nsxv3.common.synchronization [req-04ab6bb0-e75f-45f7-8307-6e5a9e64feb7 req-411051c1-19b9-4e69-90c1-5226a303be20 service nova] Enqueued Resource ID: c90f64fa-0e97-4b84-89db-6cfa33733412 with Priority: HIGHEST for action port [ 898.955829] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 898.955829] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 898.955829] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c90f64fa-0e97-4b84-89db-6cfa33733412 with Priority: HIGHEST for action port [ 898.955829] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.955829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.955829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.955829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.955829] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.956414] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.956508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.956571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.956770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.956919] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.957021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.957120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.957246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.957306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.957413] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.960562] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c90f64fa-0e97-4b84-89db-6cfa33733412 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.960681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.960746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.960911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.960988] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c90f64fa-0e97-4b84-89db-6cfa33733412',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.184154] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-f640d3ee-92c5-445a-915f-7921efdb66d1 tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 899.184714] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 899.185328] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.185456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.185512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.185759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.185906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.187360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.189166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.189166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.189166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.189166] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.464813] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.465086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.465164] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.466028] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c90f64fa-0e97-4b84-89db-6cfa33733412 with status ACTIVE [ 899.466216] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.466331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.466399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.466599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.466705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.466889] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.467040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.467124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.467293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.467376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.467565] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.467664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.467724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.467863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.467941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.468234] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c90f64fa-0e97-4b84-89db-6cfa33733412 is going to be updated. [ 899.489921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.490080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.490153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.490361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.490572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.490733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c90f64fa-0e97-4b84-89db-6cfa33733412" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.695659] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.695659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.695659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.695659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.695659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.695659] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.695955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.695955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.695955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.696065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.696097] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 already deleted. [ 899.696172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.697982] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-326 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.698186] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.698316] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.698616] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.698889] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.699094] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.699176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.699359] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.699574] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.699720] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.699831] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.699985] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.700141] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.700185] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.700273] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.700383] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.717727] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.717727] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.717868] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.718052] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.718369] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-076253a0-f49e-42fc-ab70-162003fcd6ed taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.718541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.718711] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.718959] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.719157] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('076253a0-f49e-42fc-ab70-162003fcd6ed',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.970538] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.221436] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.221689] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.221689] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.222176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.222176] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.223228] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 076253a0-f49e-42fc-ab70-162003fcd6ed not found, creating... [ 900.223228] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.223228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.223228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.223228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.223228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.223539] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.223539] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.223652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.223859] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.223996] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.224290] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 076253a0-f49e-42fc-ab70-162003fcd6ed is going to be created. [ 900.250504] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.250763] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.250945] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.251247] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.251577] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.251825] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.472405] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.472701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.472701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.472925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.473062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.473192] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 900.502800] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.502962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.503050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.503249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.503392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.511195] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 900.785735] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 900.785973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.786155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.786370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.786564] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.786681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.787178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.787178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.787178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.787178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.787336] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.991746] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-a2bc581d-1c82-4d79-baa2-2b1c75739e54 service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 900.992342] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-a2bc581d-1c82-4d79-baa2-2b1c75739e54 service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 900.992342] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-a2bc581d-1c82-4d79-baa2-2b1c75739e54 service nova] Enqueued Resource ID: 076253a0-f49e-42fc-ab70-162003fcd6ed with Priority: HIGHEST for action port [ 900.992342] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 900.992510] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 900.992510] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 076253a0-f49e-42fc-ab70-162003fcd6ed with Priority: HIGHEST for action port [ 900.993724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.996676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.996759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.997028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.997114] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.997999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.998131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.998194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.998363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.998510] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.998596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.998654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.001677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.001677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.001677] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.001677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-076253a0-f49e-42fc-ab70-162003fcd6ed taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.001677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.001677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.001677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.001677] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('076253a0-f49e-42fc-ab70-162003fcd6ed',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.289183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.289768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.289768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.289768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.289921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.289976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.290024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.290181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.290271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.290360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.290575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.290682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.290732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.290872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.291034] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.291138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.291214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.291366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.291458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.291555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.291651] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.502311] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.506203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.506203] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 076253a0-f49e-42fc-ab70-162003fcd6ed with status ACTIVE [ 901.506203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.506203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.506203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.506203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.506758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.506758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.506758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.506758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.506758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 076253a0-f49e-42fc-ab70-162003fcd6ed is going to be updated. [ 901.532844] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.532844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.532844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.532844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.532844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.532844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-076253a0-f49e-42fc-ab70-162003fcd6ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.794180] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 954e79e4-ed41-40fb-8699-8b26721b1d77: rpc.has_security_group_logging(os_id): False [ 901.815905] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.816073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.816139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.816340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.836367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.836622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.836746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.836815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.837024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.837113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.837307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.837401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.837457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.837684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.837684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.837871] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.837966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.838040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.838184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.838281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.838384] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be updated. [ 901.844614] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-5cd8c178-f0f1-482a-99f6-12e30fe40b67 tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 901.845153] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 901.845438] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.845536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.893208] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.893364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.893425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.893616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.893763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.904697] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: IN_PROGRESS for 2s [ 902.012212] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.458165] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-326 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.458165] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.458165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.458165] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.459897] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.460086] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.460209] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.460338] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 902.460450] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.460612] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.479670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.482017] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 902.482017] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.482017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.482017] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c4e1e5b0-c8be-4695-b360-41910ffc417f taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.482017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.482017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.482017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.482017] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e1e5b0-c8be-4695-b360-41910ffc417f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.514307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.514586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.514630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.514925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.518028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.518028] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be created. [ 902.522880] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 902.523100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.523521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.523733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.524140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.524316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.524353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.525388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.525388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.525388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.525388] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.536060] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.536060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.536060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.536228] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.536377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.546879] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: UNINITIALIZED for 2s [ 902.985206] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.985350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.985474] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.985837] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.986096] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.986373] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c4e1e5b0-c8be-4695-b360-41910ffc417f not found, creating... [ 902.986716] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.986950] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.987125] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.987395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.987570] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.988123] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.988123] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.988248] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.988681] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.988889] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.989127] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c4e1e5b0-c8be-4695-b360-41910ffc417f is going to be created. [ 903.009786] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.010109] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.010199] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.010441] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.010691] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.011294] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.030498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.030498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.030498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.030798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.030964] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.031088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.031155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.031317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.031406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.031546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.031643] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.031752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.031790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.031933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.035027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.035027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.035027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.035027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.035027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.035027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.035027] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.538996] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4864eea1-2a57-4824-a279-fb7f17aef5fd: rpc.has_security_group_logging(os_id): False [ 903.556591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.556767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.556834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.557013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.557113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.557308] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.557538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.557538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.557642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.557688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.557882] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.557992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.558063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.558182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.558314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.558449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.558540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.558590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.558736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.558810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.558950] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 903.617229] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.617423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.617518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.617768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.617951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.630042] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 903.917358] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 903.917623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.305273] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-eebe1204-9357-4cae-a3f7-56851bf44284 service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 904.305446] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-eebe1204-9357-4cae-a3f7-56851bf44284 service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 904.305582] env[69728]: INFO networking_nsxv3.common.synchronization [req-3b8e5e38-eb0c-47e0-a003-6aef0b009440 req-eebe1204-9357-4cae-a3f7-56851bf44284 service nova] Enqueued Resource ID: c4e1e5b0-c8be-4695-b360-41910ffc417f with Priority: HIGHEST for action port [ 904.305830] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 904.305958] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 904.306065] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4e1e5b0-c8be-4695-b360-41910ffc417f with Priority: HIGHEST for action port [ 904.306623] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.306731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.306924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.307016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.307839] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4e1e5b0-c8be-4695-b360-41910ffc417f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.307996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.308162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.308411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.308668] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4e1e5b0-c8be-4695-b360-41910ffc417f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.556670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 904.557086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.557086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.557873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.557873] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.557873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.557873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.558285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.558285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.558285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.558285] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.559345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.559454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.559655] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.560565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.560565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.560565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.560565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.560565] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.813515] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4e1e5b0-c8be-4695-b360-41910ffc417f with status ACTIVE [ 904.813515] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.813754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.813863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.814823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.814823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.814823] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.814823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.814823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.814823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.815210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.815210] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.815293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.815321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.815482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.815565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.815689] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4e1e5b0-c8be-4695-b360-41910ffc417f is going to be updated. [ 904.835183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.835492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.835492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.835687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.835687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.835812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4e1e5b0-c8be-4695-b360-41910ffc417f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.063973] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.063973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.063973] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.566471] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.644030] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 905.644267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.068544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.068736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.068787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.069861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.069861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.069861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 906.099307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.099466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.099541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.099773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.099915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.110653] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 907.225430] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.225749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.225749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.225963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.226101] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.732455] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.938761] env[69728]: INFO networking_nsxv3.common.synchronization [req-e30ffd1d-ecf4-4123-92e9-408d04eef3bb req-d67cb393-d173-447a-b77c-685c71e3c342 tempest-ServerRescueTestJSON-853328931 tempest-ServerRescueTestJSON-853328931-project-member] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 907.939344] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 907.939656] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.939783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.939853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.940048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.940210] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.940307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.940392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.940588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.940704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.940804] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.125023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.127474] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.127474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.127474] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.235611] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.445204] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.553649] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.553649] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.553649] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.553649] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.553649] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.559033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.559033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.559033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.559033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.559033] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.559033] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.559033] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.559033] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.559033] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 908.559033] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.559033] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.577502] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.577502] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 908.577502] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.577502] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.577502] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-4dcd37f0-1204-4baa-b097-75fe465af169 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.577502] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.577502] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.577502] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.577502] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dcd37f0-1204-4baa-b097-75fe465af169',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.629627] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.738446] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 908.738576] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 908.948966] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.082029] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.082266] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.082410] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.082729] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.082961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.083174] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 4dcd37f0-1204-4baa-b097-75fe465af169 not found, creating... [ 909.083449] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.083676] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.083777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.084018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.085033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.085033] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.085033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.085033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.085033] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.085391] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.085391] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 4dcd37f0-1204-4baa-b097-75fe465af169 is going to be created. [ 909.115225] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.115225] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.115225] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.115225] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.115225] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.115225] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.133277] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.451387] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.451743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.451743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.452177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.452415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.452540] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be updated. [ 909.495442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.495442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.495442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.495635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.495669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.515530] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: IN_PROGRESS for 2s [ 909.635552] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.635723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.635799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.636064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.636160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.636263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 909.670976] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.670976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.670976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.671319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.671319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.681332] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 909.722420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.722587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.722699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.722891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.738588] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 909.739635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.740777] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 909.776282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.776282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.776282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.776282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.786882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.787215] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 909.787215] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 909.787340] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 909.835469] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.838430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.838527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.838764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.840791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.840791] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 909.950491] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.950681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.950767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.951349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.951723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.952058] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 910.015912] env[69728]: INFO networking_nsxv3.common.synchronization [req-e30ffd1d-ecf4-4123-92e9-408d04eef3bb req-bb5ecbdd-5257-4cca-8ea6-0b379b37a90a service nova] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_rules [ 910.016113] env[69728]: INFO networking_nsxv3.common.synchronization [req-e30ffd1d-ecf4-4123-92e9-408d04eef3bb req-bb5ecbdd-5257-4cca-8ea6-0b379b37a90a service nova] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 910.016285] env[69728]: INFO networking_nsxv3.common.synchronization [req-e30ffd1d-ecf4-4123-92e9-408d04eef3bb req-bb5ecbdd-5257-4cca-8ea6-0b379b37a90a service nova] Enqueued Resource ID: 4dcd37f0-1204-4baa-b097-75fe465af169 with Priority: HIGHEST for action port [ 910.016916] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_rules [ 910.022822] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 910.022822] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcd37f0-1204-4baa-b097-75fe465af169 with Priority: HIGHEST for action port [ 910.022822] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.022822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.022822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.022822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.022822] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.023636] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.023748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dcd37f0-1204-4baa-b097-75fe465af169 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.024156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.024255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.025249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.028183] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dcd37f0-1204-4baa-b097-75fe465af169',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.037872] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.038105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.038259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.038501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.038724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.039118] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 910.039118] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c57c1ff9-39aa-42db-8159-2c763d036946', 'ca8a02e9-47d1-471b-858b-1d6a0bebf739', '843812e4-7adf-4d17-bf4b-07d845b47f68', '339553a7-1e43-4dfd-9442-5889c248b938', '5e3be409-32bc-4a01-bfa9-d2153d5679f3', '47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc', '32e70181-d90f-4f81-8e3c-980e1b53c1e6', 'f61f5e11-f2e6-46da-a533-dd1d28e67b4a', '875b1121-9a68-45f5-9b21-ff23d886dadb', '85f5da8c-306b-4e81-b46f-c1ac511985b0', '4195a4b3-a062-447e-88f8-e19488536bcf', '4c94ae4c-4f3f-4a89-b0b0-b5519974878e', 'e37c97c7-2869-4890-a474-cbf964f85643', 'aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc', '447fcb82-2686-43bc-be85-02c4a3f9ea8f', 'e9c4b88c-3e7a-48c7-84e2-371c7b5dffef', 'dafae610-4861-4852-9c85-d723484b91f0', '247ba3c8-bd52-444a-9315-c5fb1eb2aee6', '15661f32-f427-4619-97c6-f59aec12ec77', 'c07c53b9-b92a-425d-8250-b7f598ffd660', '3fb31477-cec0-4034-8f2e-e510893e6ddf', '00587369-d416-4d4c-b7d8-d80624c5056b', '6e9aa9c6-847d-4842-a489-0d7e99a2f946', '42bb2c30-1996-4c07-afc8-9d69bfd16f3a', '562643dd-522c-4927-b2ad-26c57a85d1e3', '05a124ad-1f1b-4827-93f7-8088f013edda', 'dd5fc210-b40b-42fd-9bcf-e190a117ea03', '7c6e384a-728d-49a1-9e35-3c446ee4ccdd', 'e1bbb88c-d56a-4e1c-b39c-5f69921fcc29', '150816be-2a89-4f94-a1c1-0b956d39c86e', '00e88d88-3454-4e14-8364-c48e1d31646f', 'd2c67d4e-4d10-4e52-a09a-e7c33344cd7a', '242249ee-0650-4468-83db-52fb528ae0d1', '69ded0e1-c75f-440b-abf9-1fb132e0a59a', '4864eea1-2a57-4824-a279-fb7f17aef5fd', '444c2dd6-94e3-450f-a206-be350b315f8e', '0ed04af6-5d88-4a9b-a4a4-60feb8636b45', '82d01262-c022-4809-a7a7-19f567af2ac0', '954e79e4-ed41-40fb-8699-8b26721b1d77', '5b4ce391-586f-4e43-aae8-8f6f4baf13c7'} {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 910.039270] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 910.059172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.059388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.059388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.059615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.059695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.059772] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 910.059871] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 910.059935] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 910.133025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.133025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.133537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.133537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.134220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.135586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 910.135586] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 910.135586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 910.135586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 910.135586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGH for action security_group_rules [ 910.135586] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGH for action security_group_rules [ 910.136092] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGH for action security_group_rules [ 910.136359] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGH for action security_group_rules [ 910.136359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.530076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.530382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.530425] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4dcd37f0-1204-4baa-b097-75fe465af169 with status ACTIVE [ 910.530669] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.530793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.530860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.531968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.531968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.531968] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.531968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.531968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.531968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.531968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.531968] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.532254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.532254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.532254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.532331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.532540] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4dcd37f0-1204-4baa-b097-75fe465af169 is going to be updated. [ 910.555724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.555878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.555949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.556198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.556339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.556508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dcd37f0-1204-4baa-b097-75fe465af169" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.273415] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3848993d-8b1b-43cd-9311-cc804334eb2a tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_rules [ 911.273952] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_rules [ 911.277220] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGH for action security_group_rules [ 911.277638] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGH for action security_group_rules [ 911.277638] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGH for action security_group_rules [ 911.277638] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f with Priority: HIGH for action security_group_rules [ 911.277787] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c07c53b9-b92a-425d-8250-b7f598ffd660 with Priority: HIGH for action security_group_rules [ 911.277787] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGH for action security_group_rules [ 911.277963] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 with Priority: HIGH for action security_group_rules [ 911.277963] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGH for action security_group_rules [ 911.278098] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGH for action security_group_rules [ 911.278250] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef with Priority: HIGH for action security_group_rules [ 911.278293] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e37c97c7-2869-4890-a474-cbf964f85643 with Priority: HIGH for action security_group_rules [ 911.278385] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e with Priority: HIGH for action security_group_rules [ 911.278488] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGH for action security_group_rules [ 911.278706] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 with Priority: HIGH for action security_group_rules [ 911.278834] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875b1121-9a68-45f5-9b21-ff23d886dadb with Priority: HIGH for action security_group_rules [ 911.278946] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc with Priority: HIGH for action security_group_rules [ 911.281591] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a with Priority: HIGH for action security_group_rules [ 911.281591] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 with Priority: HIGH for action security_group_rules [ 911.281591] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 with Priority: HIGH for action security_group_rules [ 911.281591] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339553a7-1e43-4dfd-9442-5889c248b938 with Priority: HIGH for action security_group_rules [ 911.281591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.281591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.281591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.281591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.281591] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.281591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.281591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.281591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.282334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.282334] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.282875] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.282971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.283065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.283208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.283367] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.283942] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.284053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.284117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.284264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.284331] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.284990] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.285103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.285174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.285574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.285574] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('447fcb82-2686-43bc-be85-02c4a3f9ea8f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.286431] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c07c53b9-b92a-425d-8250-b7f598ffd660 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.286697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.286697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.286765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.286797] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c07c53b9-b92a-425d-8250-b7f598ffd660',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.288017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.288114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.288176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.288349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.288420] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.289248] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.289347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.289410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.289568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.289629] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('247ba3c8-bd52-444a-9315-c5fb1eb2aee6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.290435] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.290528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.290591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.290759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.290858] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.291633] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.291748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.291801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.293036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.293036] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.293036] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.293036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.293314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.293314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.293314] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c4b88c-3e7a-48c7-84e2-371c7b5dffef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.293539] env[69728]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 911.294199] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e37c97c7-2869-4890-a474-cbf964f85643 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.294299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.294360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.294503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.294573] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e37c97c7-2869-4890-a474-cbf964f85643',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.295371] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.295480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.295555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.295705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.295779] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c94ae4c-4f3f-4a89-b0b0-b5519974878e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.296666] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.296767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.296815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.296967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.297052] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.297982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85f5da8c-306b-4e81-b46f-c1ac511985b0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.298087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.298156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.298290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.298363] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85f5da8c-306b-4e81-b46f-c1ac511985b0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.299161] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-875b1121-9a68-45f5-9b21-ff23d886dadb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.299274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.299308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.299654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.299654] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('875b1121-9a68-45f5-9b21-ff23d886dadb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.300428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.300489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.300665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.300777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.300827] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.301771] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.301771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.301771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.301987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.301987] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f61f5e11-f2e6-46da-a533-dd1d28e67b4a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.302745] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.302847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.302906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.303065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.303136] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e3be409-32bc-4a01-bfa9-d2153d5679f3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.303994] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.304109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.304171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.304316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.304387] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca8a02e9-47d1-471b-858b-1d6a0bebf739',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.305193] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-339553a7-1e43-4dfd-9442-5889c248b938 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.305303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.305399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.305516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.305588] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('339553a7-1e43-4dfd-9442-5889c248b938',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.306288] env[69728]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 911.309898] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.310913] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.310913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.311517] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.338300] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.338897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.338897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.338897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.345607] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.345607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.364660] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.364805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.366214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.366322] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be deleted. [ 911.367235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.367435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.367511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.367609] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 already deleted. [ 911.367693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.368735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.368917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.403838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.403993] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e37c97c7-2869-4890-a474-cbf964f85643 is going to be deleted. [ 911.444317] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.444507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.444546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.444759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.444890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.445052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.467192] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.467579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.468332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.468332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.468332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.468332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e37c97c7-2869-4890-a474-cbf964f85643" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.492234] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6b87f047-3710-4244-b73f-2b8d775508b0 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_rules [ 911.492873] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_rules [ 911.493298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.493440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.493510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.493787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.493871] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.526283] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 911.526635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.526803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.527031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.527233] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.527335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.527400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.527555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.527636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.527732] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.690717] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 911.691547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.691547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.691547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.691547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.691739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.691772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.692025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.692025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.692171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.692270] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.692379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.692426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.692566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.692704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.692803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.692881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.693104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.693188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.693270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.693362] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.814269] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.814441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.814494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.814711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.814886] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.814985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.815086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.815692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.815794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.815888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.815984] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.816873] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.850299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.850299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.850299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.850439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.850602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.850723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.850775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.850911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.850985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.851371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.851496] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.852389] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.852534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.852800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.852969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.853130] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.853226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.853281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.853426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.853507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.853588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.853666] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.863443] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.863575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.863657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.863865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.864037] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.864139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.864203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.864348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.864432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.864520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.864607] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.879074] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.011370] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.011589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.011700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.012299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.014719] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.014923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.015852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.016018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.016891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.017039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.019194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.019194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.019194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.019194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.019930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.020044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.021436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.021570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.022646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.022798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.023841] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.023990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.025415] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.025415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.027020] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 912.027020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.027020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.028296] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 912.028736] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.029381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.031284] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 912.031675] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.031865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.032740] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.037548] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 912.037548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.037548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 447fcb82-2686-43bc-be85-02c4a3f9ea8f is going to be deleted. [ 912.038690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.038946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.060690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.061811] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be deleted. [ 912.062029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.062148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.080390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.080553] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc is going to be deleted. [ 912.081584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.081852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.085954] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.086113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.108209] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.108448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.110660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.110884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca8a02e9-47d1-471b-858b-1d6a0bebf739 is going to be deleted. [ 912.112201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.112443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.134142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.134324] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 875b1121-9a68-45f5-9b21-ff23d886dadb is going to be deleted. [ 912.135268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.135569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.163198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.163352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.169963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.170371] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f61f5e11-f2e6-46da-a533-dd1d28e67b4a is going to be deleted. [ 912.171642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.171868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.195311] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f791dd8-c5f7-4dee-8371-74dee670bd90: rpc.has_security_group_logging(os_id): False [ 912.237836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.238094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85f5da8c-306b-4e81-b46f-c1ac511985b0 is going to be deleted. [ 912.239255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.239521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.270382] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.270382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.271119] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.271249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.273513] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.273629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.278334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.278334] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c4b88c-3e7a-48c7-84e2-371c7b5dffef is going to be deleted. [ 912.278605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.278867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.315310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.315547] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e3be409-32bc-4a01-bfa9-d2153d5679f3 is going to be deleted. [ 912.316463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.316679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.318359] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 843812e4-7adf-4d17-bf4b-07d845b47f68: rpc.has_security_group_logging(os_id): False [ 912.319288] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.487595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.487595] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c07c53b9-b92a-425d-8250-b7f598ffd660 is going to be deleted. [ 912.489591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.489591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.489591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.489591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.489591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.489591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85f5da8c-306b-4e81-b46f-c1ac511985b0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.489924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.490048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.490091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.490267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.490351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.490462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e3be409-32bc-4a01-bfa9-d2153d5679f3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.491147] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.492135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.492135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.492135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.492135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.492135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c4b88c-3e7a-48c7-84e2-371c7b5dffef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.492471] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.492557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.492619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.492791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.494289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.494412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.495578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.496575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.496575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.497012] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.497012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.497012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.497012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.497241] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.497293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.497340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.497487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.497555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.497650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.497745] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.499036] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.499549] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4195a4b3-a062-447e-88f8-e19488536bcf: rpc.has_security_group_logging(os_id): False [ 912.536053] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.549426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.549554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.568498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.568498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.568498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.568498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.568498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.568498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.568498] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 is going to be updated. [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-447fcb82-2686-43bc-be85-02c4a3f9ea8f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.569860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.570158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.570246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.570358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.570507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-47aaf99f-0a76-4e37-bfc3-c1a911a2c3dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.570673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.570848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.571098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.571138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca8a02e9-47d1-471b-858b-1d6a0bebf739" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.571754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.571997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.572156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.572386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-875b1121-9a68-45f5-9b21-ff23d886dadb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.572537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.572804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.572966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.573234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.574064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.574064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.574064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.574064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.574064] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.574064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.574429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.574429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.574429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.574549] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.574630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.574707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.574866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.574911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.574993] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be created. [ 912.576153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.576337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.576392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.576517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f61f5e11-f2e6-46da-a533-dd1d28e67b4a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.576633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.577024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.623943] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.623943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.654438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.654656] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c94ae4c-4f3f-4a89-b0b0-b5519974878e is going to be deleted. [ 912.655753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.655993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.656093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.656435] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 already deleted. [ 912.656435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.656435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.656575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.692456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.692809] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.692920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.693009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.693255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.693340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.693436] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf is going to be updated. [ 912.694602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.694771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.742427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.742624] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 247ba3c8-bd52-444a-9315-c5fb1eb2aee6 is going to be deleted. [ 912.743552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.743760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.743866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.743988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c07c53b9-b92a-425d-8250-b7f598ffd660" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.744164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.744324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.769852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.770015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.806361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.806597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.807479] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.807641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.811541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.811674] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 339553a7-1e43-4dfd-9442-5889c248b938 is going to be deleted. [ 912.812619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.812840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.813054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.813963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.814194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.814280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.814399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c94ae4c-4f3f-4a89-b0b0-b5519974878e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.814943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.815152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.815332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.824963] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32e70181-d90f-4f81-8e3c-980e1b53c1e6: rpc.has_security_group_logging(os_id): False [ 912.846181] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.846427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.846427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.846736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.854528] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 912.880550] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: IN_PROGRESS for 2s [ 912.892843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.893020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.893107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.893176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.893401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.893486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.893607] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be updated. [ 912.900810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.900980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.901087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.901397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.901570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.903608] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.903786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.903902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.904167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.904284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.904481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-247ba3c8-bd52-444a-9315-c5fb1eb2aee6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.916740] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: IN_PROGRESS for 2s [ 912.934369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.934572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.934675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.934904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.935060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.935183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-339553a7-1e43-4dfd-9442-5889c248b938" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.001868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15661f32-f427-4619-97c6-f59aec12ec77: rpc.has_security_group_logging(os_id): False [ 913.005812] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dafae610-4861-4852-9c85-d723484b91f0: rpc.has_security_group_logging(os_id): False [ 913.014114] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.014311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.014407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.014638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.015016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.038887] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.038887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.038887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.038887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.038887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.039118] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be updated. [ 913.043634] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.043804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.043889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.044111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.045989] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.046140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.053357] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 913.094375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.094666] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.094833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.094833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.095110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.095110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.095298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.095409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.095517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.095615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.095689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.095881] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.095959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.096034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.096167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.096236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.096319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 913.097452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.097615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.174470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.174913] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.175071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.175188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.175343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.175545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.175607] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 913.182989] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.185017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.185017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.185017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.185017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.195073] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: IN_PROGRESS for 2s [ 913.268498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.268769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.268975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.269217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.269399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.285765] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.286333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.286333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.286501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.286697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.294034] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 913.309262] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 913.456986] env[69728]: INFO networking_nsxv3.common.synchronization [req-b1c2700f-a8cf-4813-8575-aec0f2dd885e req-005c3330-bc55-47df-b122-002e3d783dad tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 913.457544] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 913.457872] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.457994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.458082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.458760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.458760] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.458760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.458760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.458999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.458999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.459125] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.966628] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.966628] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.966628] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 already deleted. [ 913.966628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.090165] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.090446] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.090659] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.091155] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.091542] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.091785] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.091982] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.092338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.092584] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.092950] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.093137] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.093320] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.093474] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.093637] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.093813] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.094031] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.113678] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.113962] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.114148] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.114384] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.114769] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-3403f79d-b990-4ea5-9d2e-29fa7968f76f taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.114963] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.115139] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.115480] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.115645] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3403f79d-b990-4ea5-9d2e-29fa7968f76f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.618652] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.618764] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.619834] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.619834] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.619834] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.619834] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 3403f79d-b990-4ea5-9d2e-29fa7968f76f not found, creating... [ 914.620155] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.620338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.620463] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.620747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.620902] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.621224] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.621426] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.621588] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.621802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.621964] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.622630] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 3403f79d-b990-4ea5-9d2e-29fa7968f76f is going to be created. [ 914.654027] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.654145] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.654213] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.654501] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.654737] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.655262] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.868756] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 914.868756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.868756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.868756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.868756] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.896319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: SUCCESS [ 914.896581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.926957] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: SUCCESS [ 914.927203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.064564] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 915.064859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.204583] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.207024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.207024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.207024] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.322831] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 915.322831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.332419] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 915.332419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.372874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.372874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.372874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.372874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.372874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.372874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.372874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.372874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.373252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.373252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.373252] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.688998] env[69728]: INFO networking_nsxv3.common.synchronization [req-b1c2700f-a8cf-4813-8575-aec0f2dd885e req-edc66c1c-be77-4d00-a5ec-29155b2b9efc service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 915.689342] env[69728]: INFO networking_nsxv3.common.synchronization [req-b1c2700f-a8cf-4813-8575-aec0f2dd885e req-edc66c1c-be77-4d00-a5ec-29155b2b9efc service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 915.690253] env[69728]: INFO networking_nsxv3.common.synchronization [req-b1c2700f-a8cf-4813-8575-aec0f2dd885e req-edc66c1c-be77-4d00-a5ec-29155b2b9efc service nova] Enqueued Resource ID: 3403f79d-b990-4ea5-9d2e-29fa7968f76f with Priority: HIGHEST for action port [ 915.690396] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 915.690719] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 915.690869] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3403f79d-b990-4ea5-9d2e-29fa7968f76f with Priority: HIGHEST for action port [ 915.691187] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.691313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.691410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.691625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.691710] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.692556] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.692666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.692732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.692898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.693746] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.694070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.694178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.694428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.694428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.694484] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.696522] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3403f79d-b990-4ea5-9d2e-29fa7968f76f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.696642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.696683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.697372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.699582] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3403f79d-b990-4ea5-9d2e-29fa7968f76f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.710808] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.710808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.710808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.710808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.710808] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.711704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.711871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.712080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.712207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.712829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.713128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.713472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.714404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.714404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.714684] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.875354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.875509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.875580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.876416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.876416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.876416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.876416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.876416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.876751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.876751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.876751] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.876856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.876856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.877738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.877738] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.877738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.877738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.877738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.877738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.877738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.877738] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.924764] env[69728]: INFO networking_nsxv3.common.synchronization [req-cec586ac-c8c1-4055-b178-5f41b214dc75 req-52eb1c61-9200-4fd0-95c8-eac9d3c88968 tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 915.925310] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 915.925694] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.925850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.197167] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.203802] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.203957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.204221] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3403f79d-b990-4ea5-9d2e-29fa7968f76f with status ACTIVE [ 916.204475] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.204639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.204745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.205115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.205287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.205558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.205708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.205799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.206037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.206188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.206404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.206504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.206562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.206725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.206777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.206909] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3403f79d-b990-4ea5-9d2e-29fa7968f76f is going to be updated. [ 916.218122] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c6e384a-728d-49a1-9e35-3c446ee4ccdd: rpc.has_security_group_logging(os_id): False [ 916.237384] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.237501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.237606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.237862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.238039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.238595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3403f79d-b990-4ea5-9d2e-29fa7968f76f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.239673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.239799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.239866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.240061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.258884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.259184] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.259303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.259370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.260096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.260096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.260096] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.260096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.260096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.260303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.260303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.260375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.260464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.260521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.260691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.260824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.260911] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be updated. [ 916.325684] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.325684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.325684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.325684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.325684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.343831] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: IN_PROGRESS for 2s [ 916.380948] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f791dd8-c5f7-4dee-8371-74dee670bd90: rpc.has_security_group_logging(os_id): False [ 916.419995] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.419995] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.420737] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.420737] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.420737] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.420945] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.421659] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.421822] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.421971] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.422322] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.422322] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.422451] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.422528] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.422639] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 916.422853] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.422916] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.430424] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.430557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.430619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.430847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.430930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.431147] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.431234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.431299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.431451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.431530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.431714] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.431827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.431890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.432041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.432118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.432350] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.432420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.432477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.432616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.432691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.432775] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 916.472297] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.472468] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.050 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 916.472624] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.472833] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.473473] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.473473] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.473679] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.474010] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.474283] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc183a3-9421-44e0-ad81-1fb5c62dc3fa',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.522609] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.522754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.522822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.523053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.523204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.533945] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 916.704809] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.976930] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.978055] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.978344] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.979168] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.979466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.979748] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port ccc183a3-9421-44e0-ad81-1fb5c62dc3fa not found, creating... [ 916.980214] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.980575] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.980890] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.981373] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.981714] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.982532] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.982923] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.983463] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.986495] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.986495] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.986495] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: ccc183a3-9421-44e0-ad81-1fb5c62dc3fa is going to be created. [ 917.007309] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.007309] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.007309] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.007309] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.007309] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.007309] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.208487] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.208896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.208896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.209713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.209713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.209713] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be created. [ 917.233744] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.233932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.233985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.234199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.234662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.244115] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: UNINITIALIZED for 2s [ 917.300261] env[69728]: INFO networking_nsxv3.common.synchronization [req-8266ffff-42a2-4ef1-ad3c-18421844d374 req-1066d978-df8b-4ef5-b351-66474d947c6e tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 917.300888] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 917.301952] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.301952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.301952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.301952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.301952] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.301952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.302275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.302740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.303066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.305010] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.600398] env[69728]: INFO networking_nsxv3.common.synchronization [req-8a293a3d-1e2a-4377-8bd4-0ce2da757fb6 req-71889250-f51f-4900-b771-4a8b6befe123 tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 917.601071] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 917.601506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.601506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.805883] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.858162] env[69728]: INFO networking_nsxv3.common.synchronization [req-42d3b03c-a9fb-4b60-94f1-2849c4f3a85b req-354cea1a-bfed-40a9-b099-a63a661a9b6f tempest-ServersWithSpecificFlavorTestJSON-1321527697 tempest-ServersWithSpecificFlavorTestJSON-1321527697-project-member] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 917.858709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 917.859889] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.859889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.859889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.859889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.860314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.860468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.860535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.860777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.861649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.861649] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.312076] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.358022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 918.358022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.365145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.365298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.365361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.365574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.365671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.365874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.365980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.366042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.366199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.366292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.366421] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be updated. [ 918.394759] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.395067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.395067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.395302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.395395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.402830] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 918.549220] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 918.549442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.583833] env[69728]: INFO networking_nsxv3.common.synchronization [req-cec586ac-c8c1-4055-b178-5f41b214dc75 req-8dc092d2-4b11-4cc8-8b18-676c2e809ea6 service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 918.583833] env[69728]: INFO networking_nsxv3.common.synchronization [req-cec586ac-c8c1-4055-b178-5f41b214dc75 req-8dc092d2-4b11-4cc8-8b18-676c2e809ea6 service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 918.583958] env[69728]: INFO networking_nsxv3.common.synchronization [req-cec586ac-c8c1-4055-b178-5f41b214dc75 req-8dc092d2-4b11-4cc8-8b18-676c2e809ea6 service nova] Enqueued Resource ID: ccc183a3-9421-44e0-ad81-1fb5c62dc3fa with Priority: HIGHEST for action port [ 918.588018] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 918.588018] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 918.588018] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccc183a3-9421-44e0-ad81-1fb5c62dc3fa with Priority: HIGHEST for action port [ 918.588018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.588018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.588018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.588018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.588018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.588018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.588018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.588018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.588018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccc183a3-9421-44e0-ad81-1fb5c62dc3fa',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.814922] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.815159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.815261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.815554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.815781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.815854] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 918.840515] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.840658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.840734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.840967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.841124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.852287] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 919.090021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccc183a3-9421-44e0-ad81-1fb5c62dc3fa with status ACTIVE [ 919.090021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.090143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.090143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.090349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.090429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.090615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.090714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.090841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.091013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.091094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.091341] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.091401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.091438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.091556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.091628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.091714] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccc183a3-9421-44e0-ad81-1fb5c62dc3fa is going to be updated. [ 919.113067] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.116018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.116018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.116018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.116018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.116018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccc183a3-9421-44e0-ad81-1fb5c62dc3fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.255920] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 919.256154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.256319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.257127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.257375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.257515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.259078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.259078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.259078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.259078] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.761588] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.811851] env[69728]: INFO networking_nsxv3.common.synchronization [req-d3d7df01-a697-493d-a528-ddaccb8905d8 req-4e62719f-4532-4de8-9e20-6bd9f2caaa92 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 919.812482] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 919.812882] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.813079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.813148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.813354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.813511] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.813605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.813667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.813861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.813917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.814014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.263506] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.320063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.320304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.320368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.320567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.320675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.320925] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.321041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.321109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.321297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.321378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.321467] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be deleted. [ 920.357593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.357756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.357812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.358032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.358127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.358225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.396738] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.396738] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.396738] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.396738] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.397067] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.397170] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.397298] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.397522] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.397661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.397867] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.397977] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.398592] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.398733] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.398878] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 920.399064] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.399185] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.425197] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 920.425405] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 deletion is rescheduled due to dependency. [ 920.425539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.426560] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.426759] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 920.426944] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.427189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.427591] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-57fc35a3-d135-4883-84cf-b6739bb05fc6 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.427810] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.427961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.428364] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.428540] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fc35a3-d135-4883-84cf-b6739bb05fc6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.766056] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.766056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.766469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.766469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.766469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.766551] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 920.795044] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.795200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.795266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.795519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.795651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.805267] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 920.873450] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 920.873684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.873864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.874149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.874347] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.874464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.874531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.874685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.874770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.874870] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.932310] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.932591] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.932730] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.933173] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.933354] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.933576] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 57fc35a3-d135-4883-84cf-b6739bb05fc6 not found, creating... [ 920.933986] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.934268] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.934405] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.934677] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.934813] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.935562] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.935562] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.935562] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.935815] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.935815] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.936065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 57fc35a3-d135-4883-84cf-b6739bb05fc6 is going to be created. [ 920.956589] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.958079] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.958079] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.958079] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.958079] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.958320] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.376917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.377070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.377165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.377413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.377500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.377721] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.377871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.377952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.378136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.378215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.378306] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 921.409638] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.409798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.409878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.410235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.410398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.418861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 921.987506] env[69728]: INFO networking_nsxv3.common.synchronization [req-d3d7df01-a697-493d-a528-ddaccb8905d8 req-7fa45b88-1570-4385-8d57-6c3a239147a0 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 921.987776] env[69728]: INFO networking_nsxv3.common.synchronization [req-d3d7df01-a697-493d-a528-ddaccb8905d8 req-7fa45b88-1570-4385-8d57-6c3a239147a0 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 921.987817] env[69728]: INFO networking_nsxv3.common.synchronization [req-d3d7df01-a697-493d-a528-ddaccb8905d8 req-7fa45b88-1570-4385-8d57-6c3a239147a0 service nova] Enqueued Resource ID: 57fc35a3-d135-4883-84cf-b6739bb05fc6 with Priority: HIGHEST for action port [ 921.989161] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 921.989328] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 921.989453] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57fc35a3-d135-4883-84cf-b6739bb05fc6 with Priority: HIGHEST for action port [ 921.989882] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.990162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.990265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.990489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.990595] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.992012] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.992012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.992012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.992012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.992012] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.992221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.992221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.992495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.992495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.993571] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.993571] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-57fc35a3-d135-4883-84cf-b6739bb05fc6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.993571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.993571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.993798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.993853] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57fc35a3-d135-4883-84cf-b6739bb05fc6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.496014] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.496014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.496014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.496617] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57fc35a3-d135-4883-84cf-b6739bb05fc6 with status ACTIVE [ 922.497357] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.497357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.497357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.497357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.497357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.497559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.497559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.497559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.497707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.497757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.497953] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.498053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.498107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.498290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.498356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.498442] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57fc35a3-d135-4883-84cf-b6739bb05fc6 is going to be updated. [ 922.518171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.518309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.518380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.518583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.518726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.518892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57fc35a3-d135-4883-84cf-b6739bb05fc6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.821328] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 922.821573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.821746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.822013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.822224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.822346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.822423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.822601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.822687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.822773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.822874] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.824035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.824207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.827472] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.827472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.827472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.827472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.827472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.827472] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.000441] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.327300] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.327571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.327835] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.431160] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 923.431369] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 deletion is rescheduled due to dependency. [ 923.431532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.502848] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.503028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.503094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.503307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.503392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.503494] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be created. [ 923.525082] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.525268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.525338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.525509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.525755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.540494] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: UNINITIALIZED for 2s [ 923.831637] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.338595] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.339077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.339077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.339151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.339214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.339318] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 924.367325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.368639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.368639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.368639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.368639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.379776] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 925.551735] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 925.552077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.552186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.552409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.552606] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.552724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.552793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.553053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.553053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.553192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.553192] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.803833] env[69728]: INFO networking_nsxv3.common.synchronization [req-b659d0e1-e231-4936-abcc-a2f6d7d85d62 req-3f78c7d7-1c6e-4ace-9aaa-e9b01ebc790d tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_members [ 925.803833] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_members [ 925.804399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.804532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.804684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.804854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.805037] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.805142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.805262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.805439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.805527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.805623] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.057163] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.057439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.057514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.057717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.057907] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.058021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.058099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.058282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.058374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.058468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.058632] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.058724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.058794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.059009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.059158] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.059253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.059306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.059464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.059543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.059649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.059751] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.107269] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.107546] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.107645] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.107980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.108284] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.108466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.108588] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.108886] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.109080] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.109313] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.109430] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 926.109542] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 926.109652] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 926.109761] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 926.109870] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 926.110015] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 926.128438] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 926.128624] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 926.128771] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 926.128978] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.129350] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-8ec0d408-486e-4d70-ac4b-014808a8a157 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.129548] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.129674] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.130019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.130196] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec0d408-486e-4d70-ac4b-014808a8a157',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.308383] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.308570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.308681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.308955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.309120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.309375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.309506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.309604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.309997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.309997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.310117] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 already deleted. [ 926.310153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.386793] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 926.387072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.387278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.387524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.387814] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.387967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.388049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.388277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.388403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.388550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.388740] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.388843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.388906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.389167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.389368] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.389469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.389542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.389714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.389848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.389977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.390121] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.562972] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc: rpc.has_security_group_logging(os_id): False [ 926.580057] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.580243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.580309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.580478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.580568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.580783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.580929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.580986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.581155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.581233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.581414] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.581508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.581571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.581710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.581783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.581976] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.582106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.582170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.582313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.582386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.582471] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be created. [ 926.633219] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.634053] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.634250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.634561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.634764] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.634966] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 8ec0d408-486e-4d70-ac4b-014808a8a157 not found, creating... [ 926.635296] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.635532] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.635984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.636351] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.636529] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.636869] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.637018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.637151] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.637369] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.637508] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.637694] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 8ec0d408-486e-4d70-ac4b-014808a8a157 is going to be created. [ 926.639996] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.640236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.640334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.640521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.640724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.654751] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 926.662250] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.662718] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.662718] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.662933] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.663123] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.663407] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.892394] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7481a9f3-6d05-4af7-91aa-204c1c681418: rpc.has_security_group_logging(os_id): False [ 926.913211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.913334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.913409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.913848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.913848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.913940] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.914069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.914125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.914282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.914358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.914554] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.914650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.914713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.914897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.914957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.915205] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.915260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.915294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.915447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.915494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.915568] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be created. [ 926.974644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.974793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.974867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.975101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.975280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.985096] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 927.623058] env[69728]: INFO networking_nsxv3.common.synchronization [req-b659d0e1-e231-4936-abcc-a2f6d7d85d62 req-2d004d05-4ad5-42b0-ab86-bb713234ce4f service nova] Enqueued Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_rules [ 927.623439] env[69728]: INFO networking_nsxv3.common.synchronization [req-b659d0e1-e231-4936-abcc-a2f6d7d85d62 req-2d004d05-4ad5-42b0-ab86-bb713234ce4f service nova] Enqueued Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_members [ 927.623492] env[69728]: INFO networking_nsxv3.common.synchronization [req-b659d0e1-e231-4936-abcc-a2f6d7d85d62 req-2d004d05-4ad5-42b0-ab86-bb713234ce4f service nova] Enqueued Resource ID: 8ec0d408-486e-4d70-ac4b-014808a8a157 with Priority: HIGHEST for action port [ 927.623702] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_rules [ 927.623932] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_members [ 927.623932] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ec0d408-486e-4d70-ac4b-014808a8a157 with Priority: HIGHEST for action port [ 927.624519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.624668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.624734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.624914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.625008] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.625861] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.625981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.626046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.626208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.626771] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.626880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.626944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.627110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.627197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.627293] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.628312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ec0d408-486e-4d70-ac4b-014808a8a157 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.628536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.628536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.628670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.628734] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ec0d408-486e-4d70-ac4b-014808a8a157',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.130839] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.131293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.131586] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.132777] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ec0d408-486e-4d70-ac4b-014808a8a157 with status ACTIVE [ 928.132955] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.133159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.133288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.134905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.135040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.135298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.135477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.135477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.135644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.135728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.135944] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.136039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.136102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.136248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.136327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.136414] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ec0d408-486e-4d70-ac4b-014808a8a157 is going to be updated. [ 928.158099] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.158321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.158356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.158539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.158670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.158829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ec0d408-486e-4d70-ac4b-014808a8a157" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.639091] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.669092] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 928.669365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.998763] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 928.998763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.998763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.998763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.998763] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.144743] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.144971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.144971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.145260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.145328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.145428] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 is going to be created. [ 929.168365] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.168515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.168589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.168803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.168962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.177981] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 in Status: UNINITIALIZED for 2s [ 929.501340] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.501499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.501568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.501794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.501970] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.502179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.502243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.502397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.503030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.503030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.503030] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.005526] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.005871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.005871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.005971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.006152] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.006260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.006324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.006479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.006571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.006660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.006811] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.006903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.006964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.007124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.007265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.007360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.007419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.007557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.007752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.007752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.007854] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.512569] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7481a9f3-6d05-4af7-91aa-204c1c681418: rpc.has_security_group_logging(os_id): False [ 930.529593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.529593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.529593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.529593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.530137] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.530137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.530137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.530137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.530137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.530137] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 930.537791] env[69728]: INFO networking_nsxv3.common.synchronization [req-c0268814-9331-4376-b9b9-7ab0a2a92e87 req-45452595-9f62-47c9-a4c7-639716e0187c tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 930.538372] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 930.538673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.538785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.538851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.539056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.539225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.539323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.539386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.539531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.539611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.539704] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.585512] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.585723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.585777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.586024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.586248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.597650] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 931.041765] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.042170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.042170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.042732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.067028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.067028] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.067028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.067028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.067028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.067028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.067028] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 931.100827] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.101054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.101119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.101285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.101430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.112760] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 931.188532] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 in Status: SUCCESS [ 931.188532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.188532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.189043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.189043] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.189043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.189043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.189189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.189189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.189875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.189875] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.695860] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.198731] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4: rpc.has_security_group_logging(os_id): False [ 932.217555] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.217555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.217555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.217799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.217799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.217953] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.218080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.218148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.218286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.218362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.218468] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 is going to be created. [ 932.275797] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.276090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.276090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.276335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.276446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.286815] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 in Status: IN_PROGRESS for 2s [ 932.615451] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 932.615690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.122055] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 933.122285] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 933.122401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.307122] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 in Status: SUCCESS [ 934.307417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.539435] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 935.539704] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 936.825505] env[69728]: INFO networking_nsxv3.common.synchronization [req-9083f585-1a6a-42ff-8fa3-11d8118e3701 req-ab21b054-5ce3-4dce-a1ce-8ba572c25611 tempest-FloatingIPsAssociationTestJSON-1968110794 tempest-FloatingIPsAssociationTestJSON-1968110794-project-member] Enqueued Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 936.825505] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 with Priority: HIGHEST for action security_group_members [ 936.825505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd5fc210-b40b-42fd-9bcf-e190a117ea03 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.825505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.825505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.826356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.826475] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.826585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.826648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.826836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.826983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.827045] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd5fc210-b40b-42fd-9bcf-e190a117ea03',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.329028] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.329302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.329354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.329573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.351185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.351995] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.354888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.354888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.354888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.354888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.355193] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 is going to be updated. [ 937.389641] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.389789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.389833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.390111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.390292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.402235] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: IN_PROGRESS for 2s [ 938.832817] env[69728]: INFO networking_nsxv3.common.synchronization [req-a083cb7d-f933-4e6c-ae08-9b1925974785 req-aaed7fc0-2ad1-45f4-b71b-6f1359ca4e82 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 938.836327] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 938.836781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.836913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.836983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.837236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.837416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.837643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.837643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.838130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.838130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.838130] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.340529] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.340700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.340801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.340977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.362568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.362815] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.362965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.363035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.363221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.363284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.363374] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 939.396965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.397184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.397227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.397424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.397564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.406882] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 939.410502] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 in Status: SUCCESS [ 939.410692] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd5fc210-b40b-42fd-9bcf-e190a117ea03 deletion is rescheduled due to dependency. [ 939.410831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd5fc210-b40b-42fd-9bcf-e190a117ea03" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.565168] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5e55fc1c-1fd5-44d6-978d-2400756a5858 None None] Enqueued Resource ID: df0b4553-aa3b-4db9-bf16-b41ebba9d9ad with Priority: HIGHEST for action port [ 939.565221] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0b4553-aa3b-4db9-bf16-b41ebba9d9ad with Priority: HIGHEST for action port [ 939.565786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0b4553-aa3b-4db9-bf16-b41ebba9d9ad taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.565912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0b4553-aa3b-4db9-bf16-b41ebba9d9ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.565979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0b4553-aa3b-4db9-bf16-b41ebba9d9ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.566238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0b4553-aa3b-4db9-bf16-b41ebba9d9ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.566326] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0b4553-aa3b-4db9-bf16-b41ebba9d9ad',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.071844] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df0b4553-aa3b-4db9-bf16-b41ebba9d9ad [ 940.071844] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.072193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.072193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.072262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.072365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.072495] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df0b4553-aa3b-4db9-bf16-b41ebba9d9ad already deleted. [ 940.072616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0b4553-aa3b-4db9-bf16-b41ebba9d9ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.565421] env[69728]: INFO networking_nsxv3.common.synchronization [None req-39825811-ea26-46ec-b556-955beaa009bd tempest-ServersTestBootFromVolume-645943446 tempest-ServersTestBootFromVolume-645943446-project-member] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_rules [ 940.566452] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_rules [ 940.566452] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.566452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.566452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.566711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.567015] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.651035] env[69728]: INFO networking_nsxv3.common.synchronization [None req-0cb90cf0-60ba-4581-b3db-570875133342 tempest-ServersTestBootFromVolume-645943446 tempest-ServersTestBootFromVolume-645943446-project-member] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_rules [ 940.651035] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_rules [ 940.651035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.651035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.093911] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.094256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.094256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.094354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.094449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.094593] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d already deleted. [ 941.094633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.094779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.094932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.095031] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.392035] env[69728]: INFO networking_nsxv3.common.synchronization [req-1d53064a-3230-40e1-8e7d-bec4e454b8c6 req-7ed8a894-fbf4-4f3a-82ad-49214b97fa25 tempest-ListServerFiltersTestJSON-1638024464 tempest-ListServerFiltersTestJSON-1638024464-project-member] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 941.392035] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 941.392035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.392035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.392035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.392035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.392035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.392035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.392698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.392976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.394665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.394665] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.418744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 941.418744] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 deletion is rescheduled due to dependency. [ 941.418744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.615318] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.615481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.615553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.615765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.615866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.615946] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d already deleted. [ 941.616314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.642874] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5c07a989-ae43-46ea-b62f-4e539fc008e4 None None] Enqueued Resource ID: a5900b01-46ee-4064-875f-89a764793ce3 with Priority: HIGHEST for action port [ 941.643584] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5900b01-46ee-4064-875f-89a764793ce3 with Priority: HIGHEST for action port [ 941.643793] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5900b01-46ee-4064-875f-89a764793ce3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.643916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5900b01-46ee-4064-875f-89a764793ce3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.643982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5900b01-46ee-4064-875f-89a764793ce3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.644242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5900b01-46ee-4064-875f-89a764793ce3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.644327] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5900b01-46ee-4064-875f-89a764793ce3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.899511] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.146167] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5900b01-46ee-4064-875f-89a764793ce3 [ 942.146404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.146525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.146625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.147094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.147094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.147094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5900b01-46ee-4064-875f-89a764793ce3 already deleted. [ 942.147094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5900b01-46ee-4064-875f-89a764793ce3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.311445] env[69728]: INFO networking_nsxv3.common.synchronization [req-18843009-44bc-448e-9361-16f549991345 req-16062c81-68d6-4439-aca0-bfb8dff4a6e8 tempest-ServerRescueTestJSON-853328931 tempest-ServerRescueTestJSON-853328931-project-member] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 942.312028] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 942.312323] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.312451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.312520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.312734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.312956] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.313010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.313048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.313194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.313280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.313379] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.404236] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.819504] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.906590] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.906761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.906835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.907064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.907159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.907265] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 942.936227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.936390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.936436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.936632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.936772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.944233] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 943.321753] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.826236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.826461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.826539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.826776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.827037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.827037] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be updated. [ 943.856245] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.858320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.858548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.858911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.859157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.870116] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: IN_PROGRESS for 2s [ 944.866027] env[69728]: INFO networking_nsxv3.common.synchronization [req-2383ef85-bc44-459f-85d9-af90340eae33 req-f57b6533-9fca-431d-8815-d7812045f317 tempest-ListImageFiltersTestJSON-1392908584 tempest-ListImageFiltersTestJSON-1392908584-project-member] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 944.866027] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 944.866027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.866027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.866027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.866911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.867095] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.867333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.867418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.867617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.867722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.868461] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.953232] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 944.953443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.373142] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.375285] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-ed139276-3879-47e4-9e9b-b9ff20a846af tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 945.376054] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 945.376690] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.376690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.376690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.377045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.377045] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.377213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.377213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.377606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.377606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.377606] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.798131] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-8f805ffb-c37e-4100-8477-81927565c63c tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 945.798261] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 945.798564] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.798672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.879506] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.880556] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.880690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.880761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.880975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.881079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.881316] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.881435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.881499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.881658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.881737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.881824] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 already deleted. [ 945.881903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.887492] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 945.887688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.888126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.888310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.888640] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.888760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.888827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.888983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.889175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.889175] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.242235] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-78d72c31-0063-4fa9-8b1d-fbac8027d11f tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 946.242235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 946.242235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.242235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.390604] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.390754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.390867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.391206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.391324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.391519] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be updated. [ 946.393738] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.393859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.393938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.394479] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.394577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.394651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.394885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.394928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.395057] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 already deleted. [ 946.395153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.395917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.395917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.395917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.396175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.396175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.396251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.396350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.396510] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.418578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.418578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.418578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.418790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.419029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.427201] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: IN_PROGRESS for 2s [ 946.605779] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.605979] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.606120] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.606440] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.606724] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.606885] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.607014] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.607245] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.607425] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.607640] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.607759] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 946.607887] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 946.608006] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 946.608127] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 946.608244] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 946.608382] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 946.626265] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 946.626265] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 946.626426] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 946.626572] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.626855] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.627031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.627157] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.627445] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.627589] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('791dccc4-8ce0-4ef5-8200-d872f3bc9fb5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.898957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.899443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.899489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.899682] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.899823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.899901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.900103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.900216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.900333] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 already deleted. [ 946.900401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.130728] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.131744] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.131954] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.132442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.132690] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.132898] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 not found, creating... [ 947.133248] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.133489] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.133652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.133913] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.134077] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.134405] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.134577] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.134701] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.135117] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.135300] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.135456] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 is going to be created. [ 947.155137] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.155390] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.155515] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.155799] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.156047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.156280] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.883477] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-c967e455-2b63-4ce7-bcda-14e2af533a92 service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 947.884800] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-c967e455-2b63-4ce7-bcda-14e2af533a92 service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 947.885048] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-c967e455-2b63-4ce7-bcda-14e2af533a92 service nova] Enqueued Resource ID: 791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 with Priority: HIGHEST for action port [ 947.887718] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 947.887718] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 947.887718] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 with Priority: HIGHEST for action port [ 947.887718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.887718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.887718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.887718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.887718] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.888747] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.888841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.888928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.889148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.889319] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.889417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.889512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.889710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.889837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.889950] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.891985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.892162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.892283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.892525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.892565] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('791dccc4-8ce0-4ef5-8200-d872f3bc9fb5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.393948] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.396920] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.397048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.397238] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 with status ACTIVE [ 948.397401] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.397506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.397571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.397793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.397891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.398154] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.398215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.398254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.398399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.398480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.398664] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.398756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.398817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.398961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.399902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.400045] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 791dccc4-8ce0-4ef5-8200-d872f3bc9fb5 is going to be updated. [ 948.420753] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.420894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.420963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.421175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.421339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.421524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-791dccc4-8ce0-4ef5-8200-d872f3bc9fb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.435191] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 948.435894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.819136] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.819381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-910" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.819518] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-910" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.820557] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-910" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.820557] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.820557] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.820557] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.820845] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.820845] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.820994] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.822823] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.822896] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.823501] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.823501] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 948.823501] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.823501] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.842110] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.842110] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 948.842110] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.842110] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-910" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.842529] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-206739f7-2769-4b3a-910a-4da92dbac705 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.842591] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.842685] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.843080] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.843223] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('206739f7-2769-4b3a-910a-4da92dbac705',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.904977] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.345949] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.346213] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.346347] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.346629] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.347499] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.347499] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 206739f7-2769-4b3a-910a-4da92dbac705 not found, creating... [ 949.347499] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.347499] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.347731] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.347867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.348088] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.348410] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.348578] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.348714] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.348913] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.349069] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.349490] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 206739f7-2769-4b3a-910a-4da92dbac705 is going to be created. [ 949.369635] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.369833] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.370346] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.370346] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.370503] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.370719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.405774] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.406056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.406135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.406416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.406585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.406781] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be created. [ 949.430335] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.430635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.430813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.431156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.432816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.444377] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: UNINITIALIZED for 2s [ 950.614356] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-4801d920-7b90-406b-8dd7-59a3911f7cf9 service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 950.614676] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-4801d920-7b90-406b-8dd7-59a3911f7cf9 service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 950.614735] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-4801d920-7b90-406b-8dd7-59a3911f7cf9 service nova] Enqueued Resource ID: 206739f7-2769-4b3a-910a-4da92dbac705 with Priority: HIGHEST for action port [ 950.615334] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 950.615407] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 950.615903] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 206739f7-2769-4b3a-910a-4da92dbac705 with Priority: HIGHEST for action port [ 950.619332] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.619332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.619332] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.619332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.619332] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-206739f7-2769-4b3a-910a-4da92dbac705 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.619332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.619332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.619332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.619332] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('206739f7-2769-4b3a-910a-4da92dbac705',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.940998] env[69728]: INFO networking_nsxv3.common.synchronization [req-127f5030-a472-4c9f-8e9a-4c969cbc46fa req-701731d0-0002-4e17-b2cb-27f2a7f544db tempest-ImagesOneServerTestJSON-1052527036 tempest-ImagesOneServerTestJSON-1052527036-project-member] Enqueued Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_members [ 950.941661] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_members [ 950.945302] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.945460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.945521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.946617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.946617] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.946617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.946617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.946617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.946617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.946617] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.122614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 206739f7-2769-4b3a-910a-4da92dbac705 with status ACTIVE [ 951.122614] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.122614] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.122614] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.122614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.122614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 206739f7-2769-4b3a-910a-4da92dbac705 is going to be updated. [ 951.153843] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.154767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.155730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.155730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.155730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.155730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-206739f7-2769-4b3a-910a-4da92dbac705" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.449032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.449199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.449284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.449460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.449550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.449746] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.449838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.449900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.450070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.450143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.450232] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3101a87a-3c2b-4957-a55a-4e83072e253c already deleted. [ 951.450366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.453669] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 951.453817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.453966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.454162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.454337] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.454433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.454496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.454646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.454721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.454803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.454898] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.455747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.455950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.456340] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.457670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.457670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.457670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.457670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.457670] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.698347] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.698719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-382" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.698719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-382" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.698974] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-382" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.699268] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.699432] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.699552] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.699775] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.699923] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.700152] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.700269] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.700380] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.700533] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.700659] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.700794] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.700976] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.719557] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.719777] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.719919] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.720130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-382" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.720471] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f338c052-8efa-446b-95ac-f05d7c75ed60 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.720648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.720768] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.721127] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.721264] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f338c052-8efa-446b-95ac-f05d7c75ed60',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.812069] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.813022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.813022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.813022] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.813362] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.813538] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.813803] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.813997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.814268] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.814422] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.814575] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.814719] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.814867] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.815025] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.815194] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.833094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.833279] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.833449] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.833609] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-976" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.833958] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.834160] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.834284] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.834617] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.834766] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04a5f841-5aa4-40c5-99c2-c82fc7ba2014',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.958456] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.959691] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.959830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.227941] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.228333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.228562] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.229018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.230214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.230214] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f338c052-8efa-446b-95ac-f05d7c75ed60 not found, creating... [ 952.230214] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.230419] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.230566] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.230980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.231193] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.231727] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.231990] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.232217] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.232625] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.232866] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.233126] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f338c052-8efa-446b-95ac-f05d7c75ed60 is going to be created. [ 952.261086] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.261086] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.261520] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.261581] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.261845] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.262148] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.337184] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.337457] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.337648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.337948] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.338151] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.338338] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 04a5f841-5aa4-40c5-99c2-c82fc7ba2014 not found, creating... [ 952.338659] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.338852] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.338923] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.339172] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.339364] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.339643] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.339805] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.339925] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.340184] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.340429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.340594] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 04a5f841-5aa4-40c5-99c2-c82fc7ba2014 is going to be created. [ 952.366328] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.366552] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.366688] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.366960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.367208] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.367442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.461043] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.963332] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.963724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.963724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.963866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.963866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.963956] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 953.001507] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.001687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.001755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.002201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.002488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.012670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 953.470524] env[69728]: INFO networking_nsxv3.common.synchronization [req-127f5030-a472-4c9f-8e9a-4c969cbc46fa req-c59d8d2e-1d72-49aa-902e-009fade6aa2d service nova] Enqueued Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_rules [ 953.470774] env[69728]: INFO networking_nsxv3.common.synchronization [req-127f5030-a472-4c9f-8e9a-4c969cbc46fa req-c59d8d2e-1d72-49aa-902e-009fade6aa2d service nova] Enqueued Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_members [ 953.470945] env[69728]: INFO networking_nsxv3.common.synchronization [req-127f5030-a472-4c9f-8e9a-4c969cbc46fa req-c59d8d2e-1d72-49aa-902e-009fade6aa2d service nova] Enqueued Resource ID: f338c052-8efa-446b-95ac-f05d7c75ed60 with Priority: HIGHEST for action port [ 953.471665] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_rules [ 953.471807] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_members [ 953.471915] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f338c052-8efa-446b-95ac-f05d7c75ed60 with Priority: HIGHEST for action port [ 953.472213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.472337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.472406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.472654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.472739] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.473578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.476361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.476361] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.476361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f338c052-8efa-446b-95ac-f05d7c75ed60 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.476361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.476361] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f338c052-8efa-446b-95ac-f05d7c75ed60',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.654112] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-4c63db44-5113-4ba1-ac01-9e5adf668199 service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 953.654112] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-4c63db44-5113-4ba1-ac01-9e5adf668199 service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 953.654112] env[69728]: INFO networking_nsxv3.common.synchronization [req-86552f41-68fe-4f67-9418-7c53fff9febc req-4c63db44-5113-4ba1-ac01-9e5adf668199 service nova] Enqueued Resource ID: 04a5f841-5aa4-40c5-99c2-c82fc7ba2014 with Priority: HIGHEST for action port [ 953.654112] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 953.654266] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 953.654266] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04a5f841-5aa4-40c5-99c2-c82fc7ba2014 with Priority: HIGHEST for action port [ 953.654810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.654892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.659507] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.659507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.659507] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.661770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.661770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.661770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.661770] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04a5f841-5aa4-40c5-99c2-c82fc7ba2014',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.805098] env[69728]: INFO networking_nsxv3.common.synchronization [req-2ffa78f2-1f2f-444c-b859-b7e66340904b req-f308a0c6-23f2-4880-a385-8d849df4b595 tempest-ServersNegativeTestJSON-132698298 tempest-ServersNegativeTestJSON-132698298-project-member] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 953.805649] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 953.805966] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.806114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.806186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.806391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.806546] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.806645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.806706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.806851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.807122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.807282] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.977640] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.979778] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.979900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.980113] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f338c052-8efa-446b-95ac-f05d7c75ed60 with status ACTIVE [ 953.980281] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.980388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.980453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.980766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.980858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.981129] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.981251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.981312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.981560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.981644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.981840] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.981931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.982113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.982161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.982234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.982321] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f338c052-8efa-446b-95ac-f05d7c75ed60 is going to be updated. [ 954.007406] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.007406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.007912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.007912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.008114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.008243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f338c052-8efa-446b-95ac-f05d7c75ed60" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.164775] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04a5f841-5aa4-40c5-99c2-c82fc7ba2014 with status ACTIVE [ 954.165017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.165161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.165231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.165696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.165867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.166181] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.166339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.166439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.166670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.166818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.167084] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.167275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.169503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.169503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.169503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.169503] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04a5f841-5aa4-40c5-99c2-c82fc7ba2014 is going to be updated. [ 954.192916] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.193136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.193136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.193318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.193447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.193621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04a5f841-5aa4-40c5-99c2-c82fc7ba2014" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.311270] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.368544] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.368862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.369182] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.369628] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.370056] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.370345] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.370579] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.370941] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.374427] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.374691] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.375036] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.375036] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.375145] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.375188] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.375328] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.375431] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.393514] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.393689] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.393827] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.394014] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.394335] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-07fcf680-05e9-45f8-b698-cf926e1864c6 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.394512] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.394637] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.394971] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.395139] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fcf680-05e9-45f8-b698-cf926e1864c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.480108] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.819347] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.898673] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.898673] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.898673] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.899137] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.899327] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.899536] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 07fcf680-05e9-45f8-b698-cf926e1864c6 not found, creating... [ 954.899823] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.899990] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.900120] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.900346] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.900961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.901299] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.901536] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.901669] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.901923] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.902035] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.902195] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 07fcf680-05e9-45f8-b698-cf926e1864c6 is going to be created. [ 954.920989] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.921245] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.921356] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.921960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.921960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.922205] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985707] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.985707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.985707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.985707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.985707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.985707] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3101a87a-3c2b-4957-a55a-4e83072e253c is going to be created. [ 955.021033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.021033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.021033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.021033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.024085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.024085] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 955.024085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.030892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.030892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.030892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.030892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.031728] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.032500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.032721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.035035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.035035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.035035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.035035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.035035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.035035] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.037888] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3101a87a-3c2b-4957-a55a-4e83072e253c in Status: UNINITIALIZED for 2s [ 955.326606] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.326606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.326606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.326606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.326606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.326606] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 955.356503] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.358637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.358637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.360933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.360933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.370477] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 955.537233] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70069c08-99e8-48a7-8c3c-59be136e7340: rpc.has_security_group_logging(os_id): False [ 955.541335] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.554766] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.555223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.555445] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.555840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.556083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.556465] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.556973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.557197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.557543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.557758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.559034] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.559034] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.559034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.559836] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be created. [ 955.616375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.616539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.616611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.616834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.617019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.626981] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 956.043632] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.541941] env[69728]: INFO networking_nsxv3.common.synchronization [req-2ffa78f2-1f2f-444c-b859-b7e66340904b req-db7c8ae1-adf8-4030-b157-2f809d99cdaf service nova] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_rules [ 956.542155] env[69728]: INFO networking_nsxv3.common.synchronization [req-2ffa78f2-1f2f-444c-b859-b7e66340904b req-db7c8ae1-adf8-4030-b157-2f809d99cdaf service nova] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 956.542301] env[69728]: INFO networking_nsxv3.common.synchronization [req-2ffa78f2-1f2f-444c-b859-b7e66340904b req-db7c8ae1-adf8-4030-b157-2f809d99cdaf service nova] Enqueued Resource ID: 07fcf680-05e9-45f8-b698-cf926e1864c6 with Priority: HIGHEST for action port [ 956.542846] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_rules [ 956.542980] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 956.546729] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07fcf680-05e9-45f8-b698-cf926e1864c6 with Priority: HIGHEST for action port [ 956.547497] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.547680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.547774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.548201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.548338] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.549430] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.549519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.550097] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.550248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.550340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.550566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.551192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.551192] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 956.552388] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-07fcf680-05e9-45f8-b698-cf926e1864c6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.552704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.552808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.553012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.553128] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fcf680-05e9-45f8-b698-cf926e1864c6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.580915] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.580915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.580915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.581083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.581210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.592046] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 956.755523] env[69728]: INFO networking_nsxv3.common.synchronization [req-809cba9c-ad3c-4932-87f9-6b92ca726154 req-e7063e16-19fe-4276-9d62-ba3e3379f09c tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_members [ 956.755959] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_members [ 956.756315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.756447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.756528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.756872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.758223] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.758724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.758831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.759124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.759254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.759394] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.054384] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3101a87a-3c2b-4957-a55a-4e83072e253c in Status: SUCCESS [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.054384] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.054384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.054384] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.055105] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.058960] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07fcf680-05e9-45f8-b698-cf926e1864c6 with status ACTIVE [ 957.058960] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.058960] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.058960] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.059650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.059650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.059650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.059650] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07fcf680-05e9-45f8-b698-cf926e1864c6 is going to be updated. [ 957.083564] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.083775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.083823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.084173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.084428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.084625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07fcf680-05e9-45f8-b698-cf926e1864c6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.261694] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.261866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.261919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.262168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.262265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.262469] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.262598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.262662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.262820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.262898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.263017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 already deleted. [ 957.263098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.384616] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 957.384825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.385044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.385697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.385939] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.386123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.386262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.386452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.386561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.386692] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.561549] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.561721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.561793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.562026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.562195] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.562292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.562354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.562715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.562993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.562993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.563076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.563125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.563172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.563313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.563445] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.563535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.563592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.563723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.563797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.563874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.563962] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.581683] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.581885] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.583118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.583118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.583118] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.583118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.583118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.583407] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.583407] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.583608] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.583729] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.583873] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.583989] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.584123] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 957.584280] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.584368] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.605953] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.606162] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 957.606309] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.606487] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.606817] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-48f84144-b595-46af-b964-c666287fc2e4 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.606984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.607120] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.607442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.607590] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f84144-b595-46af-b964-c666287fc2e4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.637990] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 957.638239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.638567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.638662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.638732] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.894020] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.066067] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3101a87a-3c2b-4957-a55a-4e83072e253c: rpc.has_security_group_logging(os_id): False [ 958.092924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.092924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.092924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.092924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.092924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.092924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.093211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.093211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.093211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.093312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.095031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.095031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.095031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.095031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.095031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.095031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.096761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.096894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.097081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.097168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.097262] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3101a87a-3c2b-4957-a55a-4e83072e253c is going to be created. [ 958.110878] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.111172] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.111652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.111652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.111877] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.112099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 48f84144-b595-46af-b964-c666287fc2e4 not found, creating... [ 958.112460] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.116759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.116759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.116759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.116759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.118337] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.118520] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.118648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.127828] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.127828] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.127828] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 48f84144-b595-46af-b964-c666287fc2e4 is going to be created. [ 958.142722] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.142722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.142980] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.143055] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.143153] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.143430] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.143664] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.143900] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.149157] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.149296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.149370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.149773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.149773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.160009] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3101a87a-3c2b-4957-a55a-4e83072e253c in Status: IN_PROGRESS for 2s [ 958.394562] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.601431] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 958.601711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.601905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.602174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.602368] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.602485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.602566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.602744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.602819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.602906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.603078] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.897373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.897542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.897605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.897821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.897914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.898269] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 958.924226] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.924392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.924509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.924785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.925012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.935152] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 959.105464] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.105797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.105797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.105962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.106167] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.106269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.106336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.106534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.106677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.106865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.106959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.107031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.107176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.107315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.107406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.107467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.107608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.107685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.107771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.107888] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.172924] env[69728]: INFO networking_nsxv3.common.synchronization [req-809cba9c-ad3c-4932-87f9-6b92ca726154 req-59f744f7-fbd7-4de2-a68f-49ef19cebada service nova] Enqueued Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_rules [ 959.173144] env[69728]: INFO networking_nsxv3.common.synchronization [req-809cba9c-ad3c-4932-87f9-6b92ca726154 req-59f744f7-fbd7-4de2-a68f-49ef19cebada service nova] Enqueued Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_members [ 959.173300] env[69728]: INFO networking_nsxv3.common.synchronization [req-809cba9c-ad3c-4932-87f9-6b92ca726154 req-59f744f7-fbd7-4de2-a68f-49ef19cebada service nova] Enqueued Resource ID: 48f84144-b595-46af-b964-c666287fc2e4 with Priority: HIGHEST for action port [ 959.173552] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_rules [ 959.173664] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_members [ 959.173895] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48f84144-b595-46af-b964-c666287fc2e4 with Priority: HIGHEST for action port [ 959.174681] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.174806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.174871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.178584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.178686] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.180013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.180013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.180013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.180193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.180317] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.180417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.180482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.180633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.180717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.180843] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.181709] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-48f84144-b595-46af-b964-c666287fc2e4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.181816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.181858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.181985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.185673] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48f84144-b595-46af-b964-c666287fc2e4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.609880] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70069c08-99e8-48a7-8c3c-59be136e7340: rpc.has_security_group_logging(os_id): False [ 959.630616] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.630835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.630938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.631348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.631558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.631892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.632091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.632201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.632694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.632694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.632983] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.633156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.633257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.633467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.633582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.633895] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.634077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.634222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.634429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.634611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.634781] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 959.687399] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.689009] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.689173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.689699] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48f84144-b595-46af-b964-c666287fc2e4 with status ACTIVE [ 959.689985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.690212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.690336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.690643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.690818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.691169] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.691355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.691466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.691715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.691866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.692223] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.692365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.692474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.692845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.692895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.693065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48f84144-b595-46af-b964-c666287fc2e4 is going to be updated. [ 959.711537] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.711660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.711660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.711863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.712036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.731220] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 959.744785] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.744951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.745030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.745239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.745384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.745592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48f84144-b595-46af-b964-c666287fc2e4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.169567] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3101a87a-3c2b-4957-a55a-4e83072e253c in Status: SUCCESS [ 960.169829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.190326] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.693702] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.693902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.693971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.694232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.694327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.694436] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 is going to be created. [ 960.714946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.715191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.715335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.715612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.715807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.729130] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: UNINITIALIZED for 2s [ 960.943857] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 960.944088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.944258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.944492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.944687] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.944813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.944896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.945064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.945147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.945318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.945318] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.447527] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.447799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.447799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.448066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.448148] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.448592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.448592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.448592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.448592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.448825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.448825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.448825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.448971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.449427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.449427] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.449427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.449427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.449850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.449850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.449850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.449850] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.745348] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 961.745446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.745661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.745925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.746049] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.951707] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15661f32-f427-4619-97c6-f59aec12ec77: rpc.has_security_group_logging(os_id): False [ 961.969027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.969027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.969027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.969270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.969308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.969506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.969610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.969678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.969840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.969924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.970356] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.970356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.970356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.970537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.970537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.970679] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.970774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.970835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.970979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.971066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.971152] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 962.027149] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.027265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.027348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.027570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.027740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.040696] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 962.248809] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.249867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.249867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.249867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.250216] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.250385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.250517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.250750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.250885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.251029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.251549] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.738737] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: SUCCESS [ 962.739108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.739164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.739548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.739624] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.739721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.739791] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.739950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.740050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.740140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.740237] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.754272] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.754424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.754497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.754716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.754926] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.755375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.755375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.755375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.755375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.755863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.755863] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.755863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.755863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.755863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.756063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.756135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.756135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.756300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.756353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.756473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.756579] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.242053] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.263039] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70069c08-99e8-48a7-8c3c-59be136e7340: rpc.has_security_group_logging(os_id): False [ 963.283792] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.283988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.284054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.284268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.284359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.284604] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.284712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.284777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.284941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.285032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.285239] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.285335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.285406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.285549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.285636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.285820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.285922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.285989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.286150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.286222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.286323] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 963.343751] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.344108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.344229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.344451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.344621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.358013] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 963.746600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33bba7e4-2298-4997-b67a-a02ac1558aa5: rpc.has_security_group_logging(os_id): False [ 963.767634] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.767634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.767634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.768027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.768027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.768225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.768369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.768463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.768661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.768780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.768903] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 is going to be created. [ 963.823618] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.827156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.827320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.827570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.827772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.843503] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: IN_PROGRESS for 2s [ 964.056067] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 964.056341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.176412] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 964.176520] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 965.375973] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 965.377477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.855977] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: SUCCESS [ 965.855977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.383835] env[69728]: INFO networking_nsxv3.common.synchronization [req-cb4464be-6b58-4efc-b8bc-72d1b9be5f52 req-d2367496-b7f3-4b90-bce5-8e45f2393b76 tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 967.384837] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 967.389165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.389165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.389165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.389165] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.671147] env[69728]: INFO networking_nsxv3.common.synchronization [req-cb4464be-6b58-4efc-b8bc-72d1b9be5f52 req-3e0199da-efe0-47cb-9960-d3ea668847c0 tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 967.672825] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 967.672825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.672825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.890252] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.894408] env[69728]: INFO networking_nsxv3.common.synchronization [req-cb4464be-6b58-4efc-b8bc-72d1b9be5f52 req-4fdcbe22-e63a-47e5-b6ae-887f5af40660 tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 967.894408] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 967.894408] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.894408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.392847] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.725451] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3884597-246a-44fa-8c77-41b884fc69b1 req-67866698-6fee-480d-9685-0b709e988bba tempest-AttachInterfacesV270Test-535337074 tempest-AttachInterfacesV270Test-535337074-project-member] Enqueued Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_members [ 968.729125] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_members [ 968.729125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.729125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.729125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.729125] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.896765] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.896934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.897016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.897235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.897327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.897428] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 968.924884] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.925070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.925140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.925293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.925445] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.933463] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 968.940057] env[69728]: INFO networking_nsxv3.common.synchronization [req-a2c1729b-3a31-4df0-837b-03312f944f62 req-c50a3ddc-7258-4ece-84ca-811c9d626644 tempest-ServersNegativeTestJSON-132698298 tempest-ServersNegativeTestJSON-132698298-project-member] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 968.940589] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 968.940891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.941022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.941085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.941283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.941853] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.941965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.942066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.942202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.942288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.942385] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.232468] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.232468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.232468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.232923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.232923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.232923] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.233101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.233101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.233212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.233265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.233358] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b895038e-0ce2-442d-b804-0ba2c46948e6 already deleted. [ 969.233440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.444781] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.798193] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.798520] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-16" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.798671] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-16" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.799167] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-16" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.799499] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.799730] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.799934] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.800210] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.800420] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.800725] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.800858] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.800975] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.801181] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.801376] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.801513] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.801680] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.836371] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.836575] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.836740] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.836987] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-16" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.837379] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.837611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.837748] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.838197] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.838386] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.951157] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.340906] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.341197] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.341332] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.341639] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.341931] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.342065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 not found, creating... [ 970.342347] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.342506] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.342643] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.342882] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.344446] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.344446] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.344446] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.344446] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.344446] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.346656] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.346656] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 is going to be created. [ 970.365133] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.365427] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.365562] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.365883] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.366234] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.367036] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.456539] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.456539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.456539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.456539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.456539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.456539] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 970.497560] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.497560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.497560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.497560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.497810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.507614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 970.942914] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 970.943190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.943363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.943573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.943758] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.943876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.944008] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.944106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.944188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.944281] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.413826] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3884597-246a-44fa-8c77-41b884fc69b1 req-3591f2d6-071d-4bed-a5fd-77cbb774a244 service nova] Enqueued Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_rules [ 971.413992] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3884597-246a-44fa-8c77-41b884fc69b1 req-3591f2d6-071d-4bed-a5fd-77cbb774a244 service nova] Enqueued Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_members [ 971.414151] env[69728]: INFO networking_nsxv3.common.synchronization [req-e3884597-246a-44fa-8c77-41b884fc69b1 req-3591f2d6-071d-4bed-a5fd-77cbb774a244 service nova] Enqueued Resource ID: 2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 with Priority: HIGHEST for action port [ 971.414385] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_rules [ 971.414512] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_members [ 971.414606] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 with Priority: HIGHEST for action port [ 971.416985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.417138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.417209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.417503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.417646] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.418490] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.418607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.418674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.418847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.418992] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.419095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.419155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.419292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.419371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.419460] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.424637] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.424637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.424637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.424637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.424637] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.446804] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.446954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.447036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.447255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.447348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.447546] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.447648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.447702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.447842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.447931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.448026] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 971.471581] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.471948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.471948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.472070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.472198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.480582] env[69728]: INFO networking_nsxv3.common.synchronization [req-5acbcc14-5ee5-4df1-af9b-50b675df1baa req-34dfd7d9-d892-4065-88f0-cdbd8a3c1360 tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 971.481251] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 971.481858] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 971.482436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.482567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.482626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.482814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.483211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.483211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.483211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.483361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.483361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.483438] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.875786] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.875988] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.876258] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.876545] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.876821] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.876980] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.877117] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.877335] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.877498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.877711] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.877827] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.880223] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.880223] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.880223] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 971.880223] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.880223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.898416] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.898416] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 971.898416] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.898416] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.901812] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-b0dcac6f-53f0-484e-a5ed-37cebab3a524 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.901812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.901812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.901812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.901812] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0dcac6f-53f0-484e-a5ed-37cebab3a524',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.924699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.924699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.924699] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.928087] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 with status ACTIVE [ 971.928404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.928404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.928404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.928852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.928852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.928852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.929059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.929059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.929232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.929232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.929730] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.929730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.929730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.929730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.930039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.930039] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2 is going to be updated. [ 971.951885] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.951885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.951885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.951885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.952223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.952492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c0622b0-3e76-4e58-96c0-6dd2bf88b3a2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.987457] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.987693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.987693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.987974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.009439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.009639] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.009770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.009854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.010056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.010210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.010257] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 972.037146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.037308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.037353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.037562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.037699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.045881] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 972.401239] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.401473] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.401606] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.401944] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.402131] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.402315] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port b0dcac6f-53f0-484e-a5ed-37cebab3a524 not found, creating... [ 972.402585] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.402766] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.402889] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.403127] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.403286] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.403577] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.403738] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.403861] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.404083] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.404223] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.404362] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: b0dcac6f-53f0-484e-a5ed-37cebab3a524 is going to be created. [ 972.423756] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.423756] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.423966] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.424115] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.424347] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.424568] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.426763] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.518846] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 972.519197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.932059] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.932229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.932298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.932517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.933660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.933660] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b895038e-0ce2-442d-b804-0ba2c46948e6 is going to be created. [ 972.956790] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.957018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.957103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.957286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.957449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.966748] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b895038e-0ce2-442d-b804-0ba2c46948e6 in Status: UNINITIALIZED for 2s [ 973.282277] env[69728]: INFO networking_nsxv3.common.synchronization [req-5acbcc14-5ee5-4df1-af9b-50b675df1baa req-40614ac1-96ce-4fbf-aae3-15957adefffa service nova] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_rules [ 973.282277] env[69728]: INFO networking_nsxv3.common.synchronization [req-5acbcc14-5ee5-4df1-af9b-50b675df1baa req-40614ac1-96ce-4fbf-aae3-15957adefffa service nova] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 973.282277] env[69728]: INFO networking_nsxv3.common.synchronization [req-5acbcc14-5ee5-4df1-af9b-50b675df1baa req-40614ac1-96ce-4fbf-aae3-15957adefffa service nova] Enqueued Resource ID: b0dcac6f-53f0-484e-a5ed-37cebab3a524 with Priority: HIGHEST for action port [ 973.286348] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_rules [ 973.286348] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 973.286348] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0dcac6f-53f0-484e-a5ed-37cebab3a524 with Priority: HIGHEST for action port [ 973.286348] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.286348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.286348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.286348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.286348] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.288738] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.288864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.289105] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0dcac6f-53f0-484e-a5ed-37cebab3a524 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.289212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.289275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.289481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.289556] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0dcac6f-53f0-484e-a5ed-37cebab3a524',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.490418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 973.490633] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 deletion is rescheduled due to dependency. [ 973.490750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.490928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.491172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.491367] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.491485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.491553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.491745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.491826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.491926] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.792126] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.792497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.793644] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0dcac6f-53f0-484e-a5ed-37cebab3a524 with status ACTIVE [ 973.793851] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.794087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.794087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.794309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.794400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.794611] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.794727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.794801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.795091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.795091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.795296] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.795409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.795473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.795640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.795736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.795838] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0dcac6f-53f0-484e-a5ed-37cebab3a524 is going to be updated. [ 973.821225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.821374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.821456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.821648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.821816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.821975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0dcac6f-53f0-484e-a5ed-37cebab3a524" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.994445] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.994609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.994676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.994894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.994989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.995201] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.995300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.995364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.995518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.995608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.995694] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 974.024744] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.025350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.025494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.025751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.025952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.030339] env[69728]: INFO networking_nsxv3.common.synchronization [req-33d51eeb-f9a2-489a-896f-ab6838fde493 req-4cbebf79-e629-4862-aa60-59ae8d9fbced tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_members [ 974.030928] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_members [ 974.031409] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.031580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.031687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.031983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.032310] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.032941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.033105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.033357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.033507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.033642] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.035891] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 974.052481] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 974.052679] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda deletion is rescheduled due to dependency. [ 974.052770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.052921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.053204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.053397] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.053514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.053580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.053730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.053815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.053909] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.539199] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.539199] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.539199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.541303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.541303] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 already deleted. [ 974.541303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.561825] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.980188] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b895038e-0ce2-442d-b804-0ba2c46948e6 in Status: SUCCESS [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.980188] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.980188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.980188] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.069687] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.174842] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.175259] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.175259] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.175541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.175844] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.176038] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.176195] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.176434] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.176589] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.176813] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.177126] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.177313] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.177433] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.177588] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 975.177708] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.177848] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.200254] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.200433] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 975.200583] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.200766] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.201135] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-07913661-b842-4ef3-b0a5-ed439e176183 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.201321] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.201448] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.201993] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.201993] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07913661-b842-4ef3-b0a5-ed439e176183',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.481805] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.482073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.482181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.482321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.482495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.482589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.482654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.482802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.482892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.482981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.483146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.483258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.483292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.483432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.483573] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.483665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.483730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.483862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.483929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.484019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.484115] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.571871] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.572087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.572169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.572423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.572508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.572614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 975.621255] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.621424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.621479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.621679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.621893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.645219] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 975.709787] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.710092] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.710267] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.710523] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.710764] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.710868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 07913661-b842-4ef3-b0a5-ed439e176183 not found, creating... [ 975.711173] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.711342] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.711466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.711691] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.711935] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.712181] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.712347] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.713082] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.713082] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.713082] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.713082] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 07913661-b842-4ef3-b0a5-ed439e176183 is going to be created. [ 975.733322] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.733545] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.733647] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.734550] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.734867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.735140] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.987554] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b895038e-0ce2-442d-b804-0ba2c46948e6: rpc.has_security_group_logging(os_id): False [ 976.010460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.010460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.010460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.010460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.010970] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.010970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.010970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.010970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.010970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.010970] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b895038e-0ce2-442d-b804-0ba2c46948e6 is going to be created. [ 976.047324] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 976.047324] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 deletion is rescheduled due to dependency. [ 976.047324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.065469] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.065631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.065683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.065893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.066097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.076756] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b895038e-0ce2-442d-b804-0ba2c46948e6 in Status: IN_PROGRESS for 2s [ 976.680652] env[69728]: INFO networking_nsxv3.common.synchronization [req-33d51eeb-f9a2-489a-896f-ab6838fde493 req-c388e1e4-e21b-44c3-87c9-0bdf488fe0e9 service nova] Enqueued Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_rules [ 976.680888] env[69728]: INFO networking_nsxv3.common.synchronization [req-33d51eeb-f9a2-489a-896f-ab6838fde493 req-c388e1e4-e21b-44c3-87c9-0bdf488fe0e9 service nova] Enqueued Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_members [ 976.680975] env[69728]: INFO networking_nsxv3.common.synchronization [req-33d51eeb-f9a2-489a-896f-ab6838fde493 req-c388e1e4-e21b-44c3-87c9-0bdf488fe0e9 service nova] Enqueued Resource ID: 07913661-b842-4ef3-b0a5-ed439e176183 with Priority: HIGHEST for action port [ 976.681230] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_rules [ 976.681360] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_members [ 976.681457] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07913661-b842-4ef3-b0a5-ed439e176183 with Priority: HIGHEST for action port [ 976.682600] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.683810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.683890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.684246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.684343] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.685203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.685336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.685382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.688549] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.688549] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.688549] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-07913661-b842-4ef3-b0a5-ed439e176183 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.688549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.688549] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07913661-b842-4ef3-b0a5-ed439e176183',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.189011] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.189308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.190556] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07913661-b842-4ef3-b0a5-ed439e176183 with status ACTIVE [ 977.190755] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.190875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.190945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.191175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.191486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.191486] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.191614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.191614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.191734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.191929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.192225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.192340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.192410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.192579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.192660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.192750] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07913661-b842-4ef3-b0a5-ed439e176183 is going to be updated. [ 977.194121] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.228833] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.228991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.229086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.229342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.229528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.229712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07913661-b842-4ef3-b0a5-ed439e176183" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.654483] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 977.654713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.654902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.655147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.655337] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.655455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.655524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.655660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.655739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.655825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.655917] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.698154] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.089189] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b895038e-0ce2-442d-b804-0ba2c46948e6 in Status: SUCCESS [ 978.089189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.158563] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.158768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.158856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.159138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.159348] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.159487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.159558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.159770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.159866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.159953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.160162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.160276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.160331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.160503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.162060] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.162060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.162060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.162060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.162060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.162060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.162060] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.200218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.200532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.200532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.200695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.200743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.200835] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 is going to be created. [ 978.221957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.222171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.222236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.222410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.222569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.232224] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cc1b947-36b1-4b46-9434-017900494d57 in Status: UNINITIALIZED for 2s [ 978.664634] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05a124ad-1f1b-4827-93f7-8088f013edda: rpc.has_security_group_logging(os_id): False [ 978.684488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.684488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.684488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.684742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.684882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.685097] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.685200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.685323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.685429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.685506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.685788] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.685788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.685924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.686013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.686082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.686280] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.686379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.686441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.686585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.686660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.686744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 978.747681] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.748215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.748330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.748662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.748842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.763951] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 979.004287] env[69728]: INFO networking_nsxv3.common.synchronization [req-d30054ce-5245-48ca-b75b-ed74cfd0d9f4 req-d30a09a8-816f-4c42-8af6-d6d868dc0184 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_members [ 979.007034] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_members [ 979.007146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.007319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.007430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.007729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.008796] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.008911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.009019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.009221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.010116] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.011465] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.514951] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.515268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.515268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.515422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.515570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.515701] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.515797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.515853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.516023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.516099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.516185] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 already deleted. [ 979.516267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.624177] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.624381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.624493] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.624734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.624992] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.625186] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.625310] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.625527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.625679] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.625990] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.630169] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.630494] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.630609] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.630735] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.630877] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.631057] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.649608] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.649872] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.650037] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.650260] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.650683] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-ac3f3eb0-75f7-4786-853e-7a0266ad2803 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.650992] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.651271] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.651619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.651795] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac3f3eb0-75f7-4786-853e-7a0266ad2803',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.155192] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.155299] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.156265] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.156265] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.156265] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.156265] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port ac3f3eb0-75f7-4786-853e-7a0266ad2803 not found, creating... [ 980.156484] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.156484] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.156607] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.156992] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.156992] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.158883] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.158883] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.158883] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.158883] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.158883] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.158883] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: ac3f3eb0-75f7-4786-853e-7a0266ad2803 is going to be created. [ 980.176297] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.176503] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.176631] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.176903] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.177167] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.177400] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.241946] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cc1b947-36b1-4b46-9434-017900494d57 in Status: SUCCESS [ 980.241946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.241946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.242212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.242351] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.242476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.242543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.242707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.242792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.242881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.242981] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.748426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.780528] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 980.780757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.003174] env[69728]: INFO networking_nsxv3.common.synchronization [req-d30054ce-5245-48ca-b75b-ed74cfd0d9f4 req-7d317b2d-c2b0-43a2-bb48-c34102e1e695 service nova] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_rules [ 981.003174] env[69728]: INFO networking_nsxv3.common.synchronization [req-d30054ce-5245-48ca-b75b-ed74cfd0d9f4 req-7d317b2d-c2b0-43a2-bb48-c34102e1e695 service nova] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_members [ 981.003174] env[69728]: INFO networking_nsxv3.common.synchronization [req-d30054ce-5245-48ca-b75b-ed74cfd0d9f4 req-7d317b2d-c2b0-43a2-bb48-c34102e1e695 service nova] Enqueued Resource ID: ac3f3eb0-75f7-4786-853e-7a0266ad2803 with Priority: HIGHEST for action port [ 981.003174] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_rules [ 981.003174] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_members [ 981.003174] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3f3eb0-75f7-4786-853e-7a0266ad2803 with Priority: HIGHEST for action port [ 981.003174] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.003174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.003174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.003932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.004143] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.005158] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.005423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.005623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.006049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.009583] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.009583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.009583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.009583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.009583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.009583] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.010666] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac3f3eb0-75f7-4786-853e-7a0266ad2803 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.010923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.011484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.011790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.012028] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac3f3eb0-75f7-4786-853e-7a0266ad2803',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.250573] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2cc1b947-36b1-4b46-9434-017900494d57: rpc.has_security_group_logging(os_id): False [ 981.267525] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.267676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.267744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.267957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.268064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.268304] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.268404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.268506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.268658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.268721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.268884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 is going to be created. [ 981.319266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.319431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.319503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.319734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.319930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.332942] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cc1b947-36b1-4b46-9434-017900494d57 in Status: IN_PROGRESS for 2s [ 981.514585] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.514716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.514924] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.516161] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac3f3eb0-75f7-4786-853e-7a0266ad2803 with status ACTIVE [ 981.516398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.516511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.516576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.516785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.517092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.517276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.517901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.517901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.517901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.517901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.517901] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.518316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.518316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.518316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.518316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.518456] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac3f3eb0-75f7-4786-853e-7a0266ad2803 is going to be updated. [ 981.539382] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.539507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.539815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.539961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.540064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.540218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac3f3eb0-75f7-4786-853e-7a0266ad2803" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.020613] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.524606] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.524715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.524840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.525020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.525128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.525232] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 is going to be created. [ 982.549747] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.549897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.550096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.550193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.550355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.559546] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 in Status: UNINITIALIZED for 2s [ 983.343608] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2cc1b947-36b1-4b46-9434-017900494d57 in Status: SUCCESS [ 983.343865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.570307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 in Status: SUCCESS [ 984.570654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.570861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.571070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.571299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.571421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.571489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.571646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.571725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.571812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.571946] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.077140] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.581465] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 17f6bb6d-e945-45d3-be21-e51b9566cda2: rpc.has_security_group_logging(os_id): False [ 985.603772] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.604093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.604277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.604625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.604813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.605234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.605416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.605521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.605825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.605997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.611039] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 is going to be created. [ 985.701015] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.701333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.701442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.701567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.701759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.712252] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 in Status: IN_PROGRESS for 2s [ 986.004017] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 986.004017] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 986.773683] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7c807051-dcbc-4d59-ae1a-5b26a8724fb9 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_rules [ 986.774359] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_rules [ 986.774660] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.774812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.774894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.775130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.775232] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.864147] env[69728]: INFO networking_nsxv3.common.synchronization [None req-83919771-f201-4404-b643-cf6aadcd4611 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_rules [ 986.864414] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_rules [ 986.864646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.864746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.044869] env[69728]: INFO networking_nsxv3.common.synchronization [req-0381aa57-0266-4007-a987-70c8e7003e1a req-34b9f26c-a26b-499a-98c4-35398a548cf8 tempest-AttachInterfacesV270Test-535337074 tempest-AttachInterfacesV270Test-535337074-project-member] Enqueued Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_members [ 987.045141] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGHEST for action security_group_members [ 987.049017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.049017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.049017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.049017] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.299958] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.299958] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 already deleted. [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.299958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.299958] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.553803] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.553803] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.553803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.553803] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b895038e-0ce2-442d-b804-0ba2c46948e6 is going to be updated. [ 987.584460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.584629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.584683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.585282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.585282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.593758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b895038e-0ce2-442d-b804-0ba2c46948e6 in Status: IN_PROGRESS for 2s [ 987.726885] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 in Status: SUCCESS [ 987.726885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.767723] env[69728]: INFO networking_nsxv3.common.synchronization [req-319d41da-ba12-4700-996d-66741515e0d1 req-568168ed-546b-4b73-b6c9-637de42880df tempest-ServersWithSpecificFlavorTestJSON-1321527697 tempest-ServersWithSpecificFlavorTestJSON-1321527697-project-member] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 987.768984] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 987.769758] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.771085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.771453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.777620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.777620] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.777620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.777620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.777620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.777620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.777620] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.826376] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.826522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.826593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.826800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.826887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.826983] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 already deleted. [ 987.827085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.280775] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.280949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.281064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.282704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.282704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.282704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.282704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.282704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.282704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.282704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.283035] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be updated. [ 988.310596] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.310728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.310924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.311561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.311561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.323829] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 988.331345] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-398 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.334016] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.334016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.335373] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.335546] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.335689] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.336188] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.336188] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.336188] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.336188] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.354150] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.354487] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.354590] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.354839] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-398" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.355254] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-177e5e2b-7d3f-4210-933b-0737d91c9f65 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.355556] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.355701] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.356452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.356703] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177e5e2b-7d3f-4210-933b-0737d91c9f65',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.859423] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.859777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.859777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.860111] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.860277] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.860444] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 177e5e2b-7d3f-4210-933b-0737d91c9f65 not found, creating... [ 988.860713] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.860874] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.860994] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.861238] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.861379] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.861663] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.861820] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.863071] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.863071] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.863071] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.863071] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 177e5e2b-7d3f-4210-933b-0737d91c9f65 is going to be created. [ 988.882581] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.882794] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.882929] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.883734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.883734] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.883874] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.602868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b895038e-0ce2-442d-b804-0ba2c46948e6 in Status: SUCCESS [ 989.603082] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b895038e-0ce2-442d-b804-0ba2c46948e6 deletion is rescheduled due to dependency. [ 989.603233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.631894] env[69728]: INFO networking_nsxv3.common.synchronization [req-319d41da-ba12-4700-996d-66741515e0d1 req-bdaed2f6-1ffd-4e99-8e47-e892698643a8 service nova] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 989.632080] env[69728]: INFO networking_nsxv3.common.synchronization [req-319d41da-ba12-4700-996d-66741515e0d1 req-bdaed2f6-1ffd-4e99-8e47-e892698643a8 service nova] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 989.632241] env[69728]: INFO networking_nsxv3.common.synchronization [req-319d41da-ba12-4700-996d-66741515e0d1 req-bdaed2f6-1ffd-4e99-8e47-e892698643a8 service nova] Enqueued Resource ID: 177e5e2b-7d3f-4210-933b-0737d91c9f65 with Priority: HIGHEST for action port [ 989.632474] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_rules [ 989.632607] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 989.632702] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177e5e2b-7d3f-4210-933b-0737d91c9f65 with Priority: HIGHEST for action port [ 989.633420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.633545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.633616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.633819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.633903] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.634811] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.634945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.635052] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-177e5e2b-7d3f-4210-933b-0737d91c9f65 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.635155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.635219] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.635381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.635457] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177e5e2b-7d3f-4210-933b-0737d91c9f65',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.140162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.140162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.141317] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 177e5e2b-7d3f-4210-933b-0737d91c9f65 with status ACTIVE [ 990.141534] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.141662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.141730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.141946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.142112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.142295] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.142394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.142513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.142611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.142693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.142947] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.146729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.146729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.146729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.146729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.146729] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 177e5e2b-7d3f-4210-933b-0737d91c9f65 is going to be updated. [ 990.177320] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.177548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.177548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.177737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.177874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.178057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177e5e2b-7d3f-4210-933b-0737d91c9f65" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.332821] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 990.332821] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 deletion is rescheduled due to dependency. [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.332821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.332821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.332821] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.835156] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.336975] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.839281] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.839452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.839528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.839735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.839826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.839926] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be updated. [ 991.866696] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.866893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.866979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.867686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.867686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.875620] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 993.887890] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 993.888303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.888371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.888609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.888817] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.888931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.888991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.889211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.889303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.889366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.889426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.391465] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.633396] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 994.633575] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 994.893775] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32e70181-d90f-4f81-8e3c-980e1b53c1e6: rpc.has_security_group_logging(os_id): False [ 994.910854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.911055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.911101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.911819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.911819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.911819] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.911819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.911819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.912268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.912268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.912268] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be updated. [ 994.974361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.974638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.974638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.974825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.974980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.987409] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 995.755334] env[69728]: INFO networking_nsxv3.common.synchronization [req-df065647-d88e-45cf-bd45-1e2b69781b3d req-d2ccfa70-af50-402b-9845-4c419fc78b16 tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 995.755790] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 995.756569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.756790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.756896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.757142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.757300] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.757406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.757471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.757702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.757702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.757815] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.163353] env[69728]: INFO networking_nsxv3.common.synchronization [req-b6f39038-4132-40da-863a-4925955b4b23 req-df100680-19d7-4809-8d69-bc4e82b642ca tempest-ListImageFiltersTestJSON-1392908584 tempest-ListImageFiltersTestJSON-1392908584-project-member] Enqueued Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 996.163911] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a with Priority: HIGHEST for action security_group_members [ 996.164288] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.164492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.164492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.164900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.164900] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.165124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.169070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.169287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.169388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.169489] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2c67d4e-4d10-4e52-a09a-e7c33344cd7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.239868] env[69728]: INFO networking_nsxv3.common.synchronization [req-1c564974-8f9f-49b5-ba49-4a90529e8f6d req-a9f9f085-bf15-4cef-8aa9-ab5b2497bb26 tempest-ServerRescueTestJSON-853328931 tempest-ServerRescueTestJSON-853328931-project-member] Enqueued Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 996.240437] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd with Priority: HIGHEST for action security_group_members [ 996.240786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.240910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.240981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.241232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.241400] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.241497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.241560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.241755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.241844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.241936] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c6e384a-728d-49a1-9e35-3c446ee4ccdd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.261756] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.261978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.262118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.262400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.262541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.262834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.262988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.263073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.263293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.263416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.263516] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 996.290965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.291154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.291225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.291466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.291594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.300420] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 996.672431] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.672431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.672431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.672601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.694477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.695326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.695640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.696068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.696334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.696594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.697574] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a is going to be updated. [ 996.724376] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.724619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.724781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.725060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.725264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.733920] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: IN_PROGRESS for 2s [ 996.748089] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.748089] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.748089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.748089] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd is going to be updated. [ 996.750605] env[69728]: INFO networking_nsxv3.common.synchronization [req-275c32c3-48b0-486a-b62c-4a5f41ccd201 req-072508dc-8ce0-479f-8f6f-2e1b2cdfc047 tempest-ListServerFiltersTestJSON-1638024464 tempest-ListServerFiltersTestJSON-1638024464-project-member] Enqueued Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 996.750605] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a with Priority: HIGHEST for action security_group_members [ 996.751101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ded0e1-c75f-440b-abf9-1fb132e0a59a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.751211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.751278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.754018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.754018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.754018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.754018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.754018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.754018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.754018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ded0e1-c75f-440b-abf9-1fb132e0a59a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.780102] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.780102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.780102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.780350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.780573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.790678] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: IN_PROGRESS for 2s [ 997.001653] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 997.001885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.255826] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.256294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.256294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.256430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.276349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.276661] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.276811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.276877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.277073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.277185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.277274] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a is going to be updated. [ 997.301194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.301413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.301413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.302239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.302239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.311529] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: IN_PROGRESS for 2s [ 998.317828] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 998.317828] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda deletion is rescheduled due to dependency. [ 998.317828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.745300] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a in Status: SUCCESS [ 998.745555] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2c67d4e-4d10-4e52-a09a-e7c33344cd7a deletion is rescheduled due to dependency. [ 998.745703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2c67d4e-4d10-4e52-a09a-e7c33344cd7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.802726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd in Status: SUCCESS [ 998.802909] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c6e384a-728d-49a1-9e35-3c446ee4ccdd deletion is rescheduled due to dependency. [ 998.803035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c6e384a-728d-49a1-9e35-3c446ee4ccdd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.320384] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a in Status: SUCCESS [ 999.320710] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ded0e1-c75f-440b-abf9-1fb132e0a59a deletion is rescheduled due to dependency. [ 999.320710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ded0e1-c75f-440b-abf9-1fb132e0a59a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.751733] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1001.752091] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1001.964523] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a4ab2a3-ebb3-4d00-b785-a585f4f69c37 req-8bd86bcd-a0d9-48df-9f0e-245e4f0ef3d2 tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1001.964824] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1001.965828] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.965828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.965828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.969360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.969360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.969360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.969360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.969610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.969610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.969686] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.362943] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.362943] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.363215] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.363502] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.363792] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.363997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.364189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.364492] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.364694] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.364947] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.365224] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.365445] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.365577] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.365699] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.365810] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.365947] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.394165] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.394346] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.394487] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.394669] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.394990] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-be424168-4dc4-4cf9-a6a8-779ef9932b19 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.395183] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.395307] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.395648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.395793] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be424168-4dc4-4cf9-a6a8-779ef9932b19',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.474428] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.898702] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.899047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.899098] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.899387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.899543] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.899704] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port be424168-4dc4-4cf9-a6a8-779ef9932b19 not found, creating... [ 1002.899967] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.900264] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.900444] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.900672] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.900815] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.901124] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.901289] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.901411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.901627] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.901766] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.901908] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: be424168-4dc4-4cf9-a6a8-779ef9932b19 is going to be created. [ 1002.919950] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.920157] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.920278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.920852] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.921106] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.921333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.976965] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.480303] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.480303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.480303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.480303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.480303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.480303] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1003.508070] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.508307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.508307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.508458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.508607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.516705] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1003.634287] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a4ab2a3-ebb3-4d00-b785-a585f4f69c37 req-a939a0a4-3bd3-4632-8ba8-743f61c41d36 service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 1003.634287] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a4ab2a3-ebb3-4d00-b785-a585f4f69c37 req-a939a0a4-3bd3-4632-8ba8-743f61c41d36 service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1003.634287] env[69728]: INFO networking_nsxv3.common.synchronization [req-2a4ab2a3-ebb3-4d00-b785-a585f4f69c37 req-a939a0a4-3bd3-4632-8ba8-743f61c41d36 service nova] Enqueued Resource ID: be424168-4dc4-4cf9-a6a8-779ef9932b19 with Priority: HIGHEST for action port [ 1003.635066] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 1003.635447] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1003.635889] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be424168-4dc4-4cf9-a6a8-779ef9932b19 with Priority: HIGHEST for action port [ 1003.636494] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.636840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.637150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.637580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.637852] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.639163] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.639643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.640139] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-be424168-4dc4-4cf9-a6a8-779ef9932b19 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.640497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.641867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.641867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.641867] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be424168-4dc4-4cf9-a6a8-779ef9932b19',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.110177] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4a6e975-de0f-4e8a-907c-52134df35d0b req-b6ad24f6-7694-4661-b7fc-bef3d3cc9cd1 tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1004.110177] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1004.110177] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.114650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.115075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.115394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.118017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.118017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.118017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.118017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.118017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.118017] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.147020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be424168-4dc4-4cf9-a6a8-779ef9932b19 with status ACTIVE [ 1004.147020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.147020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.147020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.147020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.147020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be424168-4dc4-4cf9-a6a8-779ef9932b19 is going to be updated. [ 1004.147809] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.147809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.183670] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.183670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.183670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.183670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.183670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.183670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be424168-4dc4-4cf9-a6a8-779ef9932b19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.549436] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.549643] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.549771] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.550047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.550311] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.550472] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.550592] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.550809] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.550958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.554554] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.554554] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.554554] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.554554] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.554554] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.554554] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.554554] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.571576] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.571576] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.571576] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.571576] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.571576] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-5ab42490-8198-406e-9986-2487aa1669d9 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.571576] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.571576] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.571576] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.571979] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ab42490-8198-406e-9986-2487aa1669d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.621043] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.621043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.621188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.621316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.621406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.621602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.621702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.621763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.621916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.621995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.622094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1004.645992] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.646152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.646220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.646416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.646556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.655654] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1005.074113] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.074359] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.074544] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.074841] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.074996] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.075175] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 5ab42490-8198-406e-9986-2487aa1669d9 not found, creating... [ 1005.075693] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.075693] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.075881] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.075945] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.076098] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.076388] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.076546] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.076666] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.076876] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.077024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.077169] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 5ab42490-8198-406e-9986-2487aa1669d9 is going to be created. [ 1005.181920] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.182369] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.182369] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.182572] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.182833] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.183592] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.526362] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1005.526613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.526788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.527014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.527208] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.527327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.527389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.527733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.527820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.527920] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.910021] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4a6e975-de0f-4e8a-907c-52134df35d0b req-6ad3f8ae-82a6-4715-a611-e43438de3b30 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 1005.910021] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4a6e975-de0f-4e8a-907c-52134df35d0b req-6ad3f8ae-82a6-4715-a611-e43438de3b30 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1005.910021] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4a6e975-de0f-4e8a-907c-52134df35d0b req-6ad3f8ae-82a6-4715-a611-e43438de3b30 service nova] Enqueued Resource ID: 5ab42490-8198-406e-9986-2487aa1669d9 with Priority: HIGHEST for action port [ 1005.910021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 1005.910021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1005.910021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab42490-8198-406e-9986-2487aa1669d9 with Priority: HIGHEST for action port [ 1005.910021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.910021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.910021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.910937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.911138] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.912070] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.912383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.912693] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ab42490-8198-406e-9986-2487aa1669d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.913021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.913197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.913540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.913741] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ab42490-8198-406e-9986-2487aa1669d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.030065] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.415909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.416309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.416309] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ab42490-8198-406e-9986-2487aa1669d9 with status ACTIVE [ 1006.416502] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.416601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.416670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.416893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.417075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.417166] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.417259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.417322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.417470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.417546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.417726] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.417820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.417880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.418034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.418110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.418195] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ab42490-8198-406e-9986-2487aa1669d9 is going to be updated. [ 1006.437169] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.437321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.437394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.437591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.437733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.437883] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ab42490-8198-406e-9986-2487aa1669d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.532585] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.664949] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1006.665154] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 1006.665269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.665420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.665639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.665824] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.665974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.666087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.666262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.666350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.666449] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.035621] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.035825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.035898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.036181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.036280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.036384] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1007.062489] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.062489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.062489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.062489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.062489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.070757] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1007.168306] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.670665] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.173559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.173559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.173559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.173800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.173800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.174017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1008.202423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.202580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.202649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.202862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.203020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.214132] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1009.082079] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1009.082079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.082079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.082587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.082587] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.082725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.082725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.082948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.083047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.083160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.083262] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.588186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.588186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.588186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.588574] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.588574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.588574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.588574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.588705] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.588782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.588917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.592316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.594240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.594240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.594240] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.861898] env[69728]: INFO networking_nsxv3.common.synchronization [req-842c7c4a-443e-4aef-b64b-f21761794e8c req-c9b52a2b-8e9a-4be7-8c2b-62b6cc7cb772 tempest-VolumesAdminNegativeTest-8298396 tempest-VolumesAdminNegativeTest-8298396-project-member] Enqueued Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_members [ 1009.863209] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_members [ 1009.863741] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.863937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.864105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.864845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.865103] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.865280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.865401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.865688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.865852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.866061] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.096468] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7481a9f3-6d05-4af7-91aa-204c1c681418: rpc.has_security_group_logging(os_id): False [ 1010.116314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.116487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.116566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.116838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.116967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.117293] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.118214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.118214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.118214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.118214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.118214] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.120825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.120924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.122352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.122352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.122352] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.122352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.122352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.122352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.122352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.122352] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1010.179245] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.179585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.179585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.179688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.179982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.194212] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1010.223196] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1010.223435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.223601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.223834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.224040] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.224157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.224217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.224377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.224469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.224599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.224666] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.372033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.372033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.372033] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9274321f-9360-470e-a510-f63db8b66689 already deleted. [ 1010.372033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.699168] env[69728]: INFO networking_nsxv3.common.synchronization [req-17d0f587-8daa-4d12-9f03-92aa77b8bac6 req-f8257fd5-8334-426f-9aeb-1057fab0f29d tempest-ImagesOneServerTestJSON-1052527036 tempest-ImagesOneServerTestJSON-1052527036-project-member] Enqueued Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_members [ 1010.699168] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3101a87a-3c2b-4957-a55a-4e83072e253c with Priority: HIGHEST for action security_group_members [ 1010.699168] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3101a87a-3c2b-4957-a55a-4e83072e253c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.699168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.699168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.699568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.702522] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.702522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.702522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.702522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.702522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.702522] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3101a87a-3c2b-4957-a55a-4e83072e253c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.730020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.730020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.730020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.730020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.730020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.730866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.730866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.730866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.730866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.730866] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.769429] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-642 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.769429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.769429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.769429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.769429] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.769429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.773023] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.773023] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.773023] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.773023] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.773023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1010.773023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1010.773023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1010.773023] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1010.773023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1010.773023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1010.789376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1010.789550] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1010.789692] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1010.789888] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-642" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.790251] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-78c59aac-515e-4161-a25b-f0a7f4e7715a taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.790523] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.790612] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.790933] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.791134] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c59aac-515e-4161-a25b-f0a7f4e7715a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.203339] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.203594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.203594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.203841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.203917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.204420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.204420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.204420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.204420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.204810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.204810] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3101a87a-3c2b-4957-a55a-4e83072e253c is going to be updated. [ 1011.231312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.231455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.231529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.231734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.231869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.235414] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4864eea1-2a57-4824-a279-fb7f17aef5fd: rpc.has_security_group_logging(os_id): False [ 1011.241271] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3101a87a-3c2b-4957-a55a-4e83072e253c in Status: IN_PROGRESS for 2s [ 1011.253364] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.253364] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.253364] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.253364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.253983] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.253983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.253983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.253983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.253983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.253983] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1011.293710] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.293974] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.294119] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.294403] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.294554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.294714] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 78c59aac-515e-4161-a25b-f0a7f4e7715a not found, creating... [ 1011.294984] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.295169] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.295301] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.297879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.297879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.297879] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.297879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.297879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.297879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.297879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.297879] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 78c59aac-515e-4161-a25b-f0a7f4e7715a is going to be created. [ 1011.314599] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.314780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.314859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.317788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.317951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.320040] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.320220] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.320368] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.320707] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.320925] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.321157] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.334038] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1012.094941] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4369359-b37b-4b71-9ae9-2240eeeca449 req-047dab32-df6b-4a76-b358-c0b1e12b0f86 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1012.094941] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1012.094941] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.094941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.094941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.097825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.097825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.097825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.097825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.097825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.097825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.097825] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.208542] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1012.209375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.353907] env[69728]: INFO networking_nsxv3.common.synchronization [req-842c7c4a-443e-4aef-b64b-f21761794e8c req-ca1db70f-480f-4f2e-a0d7-ac98c67104c9 service nova] Enqueued Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_rules [ 1012.355634] env[69728]: INFO networking_nsxv3.common.synchronization [req-842c7c4a-443e-4aef-b64b-f21761794e8c req-ca1db70f-480f-4f2e-a0d7-ac98c67104c9 service nova] Enqueued Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_members [ 1012.355950] env[69728]: INFO networking_nsxv3.common.synchronization [req-842c7c4a-443e-4aef-b64b-f21761794e8c req-ca1db70f-480f-4f2e-a0d7-ac98c67104c9 service nova] Enqueued Resource ID: 78c59aac-515e-4161-a25b-f0a7f4e7715a with Priority: HIGHEST for action port [ 1012.356969] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_rules [ 1012.357260] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_members [ 1012.357482] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c59aac-515e-4161-a25b-f0a7f4e7715a with Priority: HIGHEST for action port [ 1012.357867] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.358180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.358363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.358765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.358998] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.360466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.361029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.362321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.362321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.362321] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.362321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.362321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.362321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.362321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.365030] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.365030] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-78c59aac-515e-4161-a25b-f0a7f4e7715a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.365030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.365030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.365030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.365030] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c59aac-515e-4161-a25b-f0a7f4e7715a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.566990] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.567230] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.567361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.567634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.567915] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.568515] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.568515] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.568515] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.568743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.568990] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.569162] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.569311] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.569459] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.569614] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1012.569760] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.569931] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.588263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.588478] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1012.588660] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.588867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.589205] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.589419] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.589552] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.589860] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.590013] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca4f24d-028c-4fbe-a2cc-d85b21fbceea',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.598447] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.598570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.598623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.598807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.617847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.618101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.618264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.618354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.618534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.618620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.618710] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1012.642225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.642420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.642420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.642640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.642777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.650603] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1012.866116] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.867233] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.867233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.867695] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78c59aac-515e-4161-a25b-f0a7f4e7715a with status ACTIVE [ 1012.867766] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.867831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.867903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.868102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.868193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.868361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.868457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.868521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.868663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.868736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.868977] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.869409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.869409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.869548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.869548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.869646] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78c59aac-515e-4161-a25b-f0a7f4e7715a is going to be updated. [ 1012.889149] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.889284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.889348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.889535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.889665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.889819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78c59aac-515e-4161-a25b-f0a7f4e7715a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.091953] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.092220] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.092357] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.093637] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.093740] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.093861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 8ca4f24d-028c-4fbe-a2cc-d85b21fbceea not found, creating... [ 1013.094154] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.094324] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.094449] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.094693] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.094840] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.095161] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.095324] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.095447] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.095664] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.095805] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.095950] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 8ca4f24d-028c-4fbe-a2cc-d85b21fbceea is going to be created. [ 1013.115043] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.115203] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.115307] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.115549] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.115777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.116011] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.251902] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3101a87a-3c2b-4957-a55a-4e83072e253c in Status: SUCCESS [ 1013.252179] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3101a87a-3c2b-4957-a55a-4e83072e253c deletion is rescheduled due to dependency. [ 1013.252224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3101a87a-3c2b-4957-a55a-4e83072e253c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.347367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1013.347617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.368585] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.871064] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.871064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.871064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.871064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.871064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.871064] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9274321f-9360-470e-a510-f63db8b66689 is going to be created. [ 1013.894151] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.894376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.894376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.894617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.894727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.903884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9274321f-9360-470e-a510-f63db8b66689 in Status: UNINITIALIZED for 2s [ 1014.169280] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ef16c74-c203-4a94-97cc-63d1e32976b4 req-86b98e06-422c-4ce4-8fcb-5afda8060625 tempest-ServersTestBootFromVolume-645943446 tempest-ServersTestBootFromVolume-645943446-project-member] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_members [ 1014.169800] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_members [ 1014.170175] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.170292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.170381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.170655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.170801] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.171070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.171070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.171614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.171614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.171614] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.224157] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4369359-b37b-4b71-9ae9-2240eeeca449 req-3d796d23-b1bc-40dc-b174-424315e5888c service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1014.224359] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4369359-b37b-4b71-9ae9-2240eeeca449 req-3d796d23-b1bc-40dc-b174-424315e5888c service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1014.224479] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4369359-b37b-4b71-9ae9-2240eeeca449 req-3d796d23-b1bc-40dc-b174-424315e5888c service nova] Enqueued Resource ID: 8ca4f24d-028c-4fbe-a2cc-d85b21fbceea with Priority: HIGHEST for action port [ 1014.224700] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1014.224824] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1014.224917] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ca4f24d-028c-4fbe-a2cc-d85b21fbceea with Priority: HIGHEST for action port [ 1014.228695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.228860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.228949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.229188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.229609] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.232379] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.232379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.232726] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.232726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.233245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.233698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.233772] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ca4f24d-028c-4fbe-a2cc-d85b21fbceea',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.660772] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1014.661029] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b deletion is rescheduled due to dependency. [ 1014.661029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.661152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.661487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.661805] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.661939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.662009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.662186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.662269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.662368] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.676487] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.676680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.676797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.676969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.677070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.677271] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.677370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.677474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.678424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.678424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.678424] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d already deleted. [ 1014.678424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.684563] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.685118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.685118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.685361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.685611] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.685772] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.686127] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.686388] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.686601] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.686866] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.686996] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1014.687174] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1014.687345] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1014.687511] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1014.687675] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1014.687863] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1014.709478] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1014.709478] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1014.709478] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1014.709478] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.709478] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-8f794c32-0135-4999-8f5e-c13eb0a72bac taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.709478] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.709478] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.709759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.710996] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f794c32-0135-4999-8f5e-c13eb0a72bac',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.736802] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.736802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.736802] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ca4f24d-028c-4fbe-a2cc-d85b21fbceea with status ACTIVE [ 1014.736802] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.736802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.736802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.736802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.736802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.736802] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.737588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.737588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.737588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.737588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.737718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.738367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.738367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.738367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.738367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.738367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ca4f24d-028c-4fbe-a2cc-d85b21fbceea is going to be updated. [ 1014.758575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.758683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.758683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.758872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.759012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.759435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ca4f24d-028c-4fbe-a2cc-d85b21fbceea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.165569] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.213474] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.213722] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.213859] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.214147] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.214523] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.214523] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 8f794c32-0135-4999-8f5e-c13eb0a72bac not found, creating... [ 1015.214723] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.214895] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.215036] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.215250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.215393] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.215679] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.215841] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.215963] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.216188] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.216326] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.216469] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 8f794c32-0135-4999-8f5e-c13eb0a72bac is going to be created. [ 1015.236996] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.237226] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.237334] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.237603] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.238272] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.238272] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.673427] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.913179] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ef16c74-c203-4a94-97cc-63d1e32976b4 req-ff255c26-9ce8-47ac-b9a7-7af3f2fa3bd9 service nova] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_rules [ 1015.913400] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ef16c74-c203-4a94-97cc-63d1e32976b4 req-ff255c26-9ce8-47ac-b9a7-7af3f2fa3bd9 service nova] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_members [ 1015.913587] env[69728]: INFO networking_nsxv3.common.synchronization [req-7ef16c74-c203-4a94-97cc-63d1e32976b4 req-ff255c26-9ce8-47ac-b9a7-7af3f2fa3bd9 service nova] Enqueued Resource ID: 8f794c32-0135-4999-8f5e-c13eb0a72bac with Priority: HIGHEST for action port [ 1015.914591] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9274321f-9360-470e-a510-f63db8b66689 in Status: SUCCESS [ 1015.914792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.915393] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_rules [ 1015.915573] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_members [ 1015.915714] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f794c32-0135-4999-8f5e-c13eb0a72bac with Priority: HIGHEST for action port [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.917209] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.917209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.917209] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.918076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.918217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.918287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.918513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.918628] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.919492] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.919614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.919747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.920279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.920511] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.920564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.920650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.920802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.921423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.921521] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.922324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f794c32-0135-4999-8f5e-c13eb0a72bac taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.922456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.922534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.922690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.922807] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f794c32-0135-4999-8f5e-c13eb0a72bac',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.174294] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.174294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.174294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.174584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.174626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.174705] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1016.202015] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.202015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.202015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.202015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.202015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.213364] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1016.427140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.428172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.428172] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.428172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.428172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.428361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.428623] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.428623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.428821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.428917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.429220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.429220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.429220] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.429419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.429419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.430269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.430388] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.430542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.430611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.430811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.430899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.431024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.431171] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.432226] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f794c32-0135-4999-8f5e-c13eb0a72bac with status ACTIVE [ 1016.432473] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.432586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.432683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.432827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.432939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.433142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.433275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.433351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.433535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.433633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.433863] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.433998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.434080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.434266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.434398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.434537] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f794c32-0135-4999-8f5e-c13eb0a72bac is going to be updated. [ 1016.435889] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.443819] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-0071cf92-b697-49d9-b949-f8e5d9ec48fc tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1016.443940] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1016.444208] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.444338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.444401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.444775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.444775] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.444922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.444922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.445079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.445166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.445297] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.454017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.454162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.454277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.454413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.454542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.454746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f794c32-0135-4999-8f5e-c13eb0a72bac" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.766178] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-326 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.766498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.766498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.766689] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.767101] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.767353] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.767518] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.767784] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.767982] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.768268] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.768390] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1016.768504] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1016.768617] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1016.768855] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1016.769059] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1016.769206] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1016.790910] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1016.791198] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1016.791553] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1016.791553] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.791966] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-15c76438-8e7a-4c35-af69-f44c25835ab8 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.792960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.792960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.792960] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.792960] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15c76438-8e7a-4c35-af69-f44c25835ab8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.938190] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9274321f-9360-470e-a510-f63db8b66689: rpc.has_security_group_logging(os_id): False [ 1016.939201] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.950488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.950488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.950488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.950731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.950782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.951343] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.951343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.951343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.951343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.951343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.951629] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1016.959615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.959741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.959801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.959980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.960135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.960394] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.960531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.960592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.960706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.960785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.960963] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.961071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.961134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.961271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.961332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.961519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.961621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.961698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.961843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.961919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.962011] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9274321f-9360-470e-a510-f63db8b66689 is going to be created. [ 1016.976717] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.976929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.977035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.977269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.977446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.988594] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1017.028299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.028485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.028561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.028733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.028952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.038841] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9274321f-9360-470e-a510-f63db8b66689 in Status: IN_PROGRESS for 2s [ 1017.295979] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.296294] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.296976] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.296976] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.297125] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.297220] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 15c76438-8e7a-4c35-af69-f44c25835ab8 not found, creating... [ 1017.297545] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.297763] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.297924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.298205] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.298398] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.299223] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.299455] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.299620] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.299890] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.300094] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.300288] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 15c76438-8e7a-4c35-af69-f44c25835ab8 is going to be created. [ 1017.319716] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.319928] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.320062] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.320368] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.320621] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.321389] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.441196] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.442039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.442039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.442039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.442039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.442239] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d is going to be created. [ 1017.475865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.475865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.475865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.477830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.477830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.489401] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d in Status: UNINITIALIZED for 2s [ 1018.038146] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-8f312b8c-7cd8-4aac-9e28-27ca9d117edc service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 1018.038146] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-8f312b8c-7cd8-4aac-9e28-27ca9d117edc service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1018.038146] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-8f312b8c-7cd8-4aac-9e28-27ca9d117edc service nova] Enqueued Resource ID: 15c76438-8e7a-4c35-af69-f44c25835ab8 with Priority: HIGHEST for action port [ 1018.038146] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 1018.038146] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1018.038146] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c76438-8e7a-4c35-af69-f44c25835ab8 with Priority: HIGHEST for action port [ 1018.038146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.038146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.038146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.038146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.038146] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.040301] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.040575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.041324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-15c76438-8e7a-4c35-af69-f44c25835ab8 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.041988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.042152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.042420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.042606] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15c76438-8e7a-4c35-af69-f44c25835ab8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.225186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.225186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.225186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.225186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.541031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.541031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.544474] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15c76438-8e7a-4c35-af69-f44c25835ab8 with status ACTIVE [ 1018.544696] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.544822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.544908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.545175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.545415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.545659] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.545824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.545942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.546183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.546318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.546570] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.546735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.546867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.547172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.547172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.547304] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15c76438-8e7a-4c35-af69-f44c25835ab8 is going to be updated. [ 1018.568309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.568564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.568683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.568948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.569201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.569428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15c76438-8e7a-4c35-af69-f44c25835ab8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.726724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.726886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.727834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.727834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.727834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.727834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.727834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.727834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.728221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.728221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.728221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.728221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.728346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.728417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.728568] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.728678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.728709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.728875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.728977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.729049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.729146] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.998175] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1018.998384] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 deletion is rescheduled due to dependency. [ 1018.998499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.998657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.998875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.999107] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.999180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.999244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.999429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.999475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.999567] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.054562] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9274321f-9360-470e-a510-f63db8b66689 in Status: SUCCESS [ 1019.054826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.231762] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00587369-d416-4d4c-b7d8-d80624c5056b: rpc.has_security_group_logging(os_id): False [ 1019.259848] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.259848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.259848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.259848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.259848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.259848] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.260366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.260422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.261069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.261249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.261499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.261861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.262257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.262953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.263109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.263695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.263850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.263976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.265210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.265300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.265390] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1019.276977] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-a414031b-dc7a-4813-ae5b-0723db016fe0 tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1019.277490] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1019.277813] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.277901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.350797] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.350797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.350797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.350797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.350797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.362697] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1019.500706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d in Status: SUCCESS [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.500706] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.500706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.500706] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.504637] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.780598] env[69728]: INFO networking_nsxv3.common.synchronization [None req-19bfe8fd-24f7-4d9f-8f56-fcfc083335c4 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1019.781816] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1019.784938] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.785089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.785160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.785367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.785526] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.785622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.785686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.785835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.785922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.786026] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.940392] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-326 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.940658] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.940831] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.941147] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.941425] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.941656] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.941813] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.942100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.942258] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.942475] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.942602] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.942732] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.942846] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.942960] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.943103] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.943244] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.964246] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.964246] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.964246] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.964246] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-326" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.964246] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-dc373764-fd3d-48dd-9eda-acba03e341cc taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.964246] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.964246] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.964246] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.964246] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc373764-fd3d-48dd-9eda-acba03e341cc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.014014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.014014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.288154] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.467353] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.467615] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.467766] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.468088] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.468244] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.468415] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port dc373764-fd3d-48dd-9eda-acba03e341cc not found, creating... [ 1020.468684] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.468864] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.468999] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.469263] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.469409] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.469696] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.469853] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.469975] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.470264] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.470413] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.470588] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: dc373764-fd3d-48dd-9eda-acba03e341cc is going to be created. [ 1020.490258] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.490473] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.490655] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.491083] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.491375] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.491614] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.515274] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a60e6b6-dc67-4740-938b-2f3c64059d3d: rpc.has_security_group_logging(os_id): False [ 1020.516478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.516646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.516715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.516923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.517036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.517136] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1020.535386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.535527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.535603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.535889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.535979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.536236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.536414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.536414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.536549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.536624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.536706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d is going to be created. [ 1020.567923] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.568081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.568148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.568357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.568495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.586610] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1020.685039] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.685039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.685039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.685039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.685209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.699579] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d in Status: IN_PROGRESS for 2s [ 1020.792570] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.295450] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.295834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.295834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.296014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.296014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.296127] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1021.324197] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.324347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.324404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.324618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.324764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.336144] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1021.377411] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1021.377411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.403740] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-3e06de54-f784-45ad-a678-569c06ed8f67 service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 1021.404378] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-3e06de54-f784-45ad-a678-569c06ed8f67 service nova] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1021.405461] env[69728]: INFO networking_nsxv3.common.synchronization [req-9c10557f-0be0-4814-bbf9-395f0047cbc8 req-3e06de54-f784-45ad-a678-569c06ed8f67 service nova] Enqueued Resource ID: dc373764-fd3d-48dd-9eda-acba03e341cc with Priority: HIGHEST for action port [ 1021.405666] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_rules [ 1021.406349] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1021.406349] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc373764-fd3d-48dd-9eda-acba03e341cc with Priority: HIGHEST for action port [ 1021.406422] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.406642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.406901] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.407073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.407362] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc373764-fd3d-48dd-9eda-acba03e341cc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.407513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.407621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.407887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.408251] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc373764-fd3d-48dd-9eda-acba03e341cc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.911931] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc373764-fd3d-48dd-9eda-acba03e341cc with status ACTIVE [ 1021.912199] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.912519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.912519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.912854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.912854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.912930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.913044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.913098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.913300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.913343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.913545] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.913650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.913696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.913903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.913954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.914141] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc373764-fd3d-48dd-9eda-acba03e341cc is going to be updated. [ 1021.943331] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.943533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.943639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.945925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.945925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.945925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc373764-fd3d-48dd-9eda-acba03e341cc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.527253] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.527526] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.527526] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.528483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.528483] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.528700] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.528773] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.529008] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.529159] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.529382] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.529496] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.529607] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.529715] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.529823] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.529929] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.530084] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.553214] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.553214] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.553214] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.553214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.553214] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-11de68fb-baa0-4966-9462-edc6ce399792 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.553214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.553214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.553214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.554401] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11de68fb-baa0-4966-9462-edc6ce399792',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.596227] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1022.596227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.596227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.596227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.596227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.596382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.596411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.596552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.596634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.596723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.596824] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.599035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.599382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.599455] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.599520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.599566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.599727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.599809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.599913] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.711461] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d in Status: SUCCESS [ 1022.711763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.798332] env[69728]: INFO networking_nsxv3.common.synchronization [req-5076df73-7276-4b18-974a-778b19783cf4 req-957ab897-548c-46b6-9716-0c41f6640ec3 tempest-MigrationsAdminTest-770467406 tempest-MigrationsAdminTest-770467406-project-member] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 1022.798910] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 1022.799630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.799630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.799630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.799869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.799924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.800044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.800106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.800263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.800685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.800685] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.057793] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.058016] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.058163] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.058457] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.058609] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.058769] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 11de68fb-baa0-4966-9462-edc6ce399792 not found, creating... [ 1023.059044] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.059212] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.059331] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.059550] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.059690] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.059988] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.060156] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.060287] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.060660] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.060829] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.060979] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 11de68fb-baa0-4966-9462-edc6ce399792 is going to be created. [ 1023.085493] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.085493] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.085708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.086186] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.086186] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.086496] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.104543] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.104543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.104543] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.302160] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.344587] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1023.345509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.606725] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.796250] env[69728]: INFO networking_nsxv3.common.synchronization [req-d9789ede-1188-47dc-9dc8-79f997c75c62 req-192cccf5-4507-41e5-b193-707773d01ef2 service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1023.796433] env[69728]: INFO networking_nsxv3.common.synchronization [req-d9789ede-1188-47dc-9dc8-79f997c75c62 req-192cccf5-4507-41e5-b193-707773d01ef2 service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1023.796582] env[69728]: INFO networking_nsxv3.common.synchronization [req-d9789ede-1188-47dc-9dc8-79f997c75c62 req-192cccf5-4507-41e5-b193-707773d01ef2 service nova] Enqueued Resource ID: 11de68fb-baa0-4966-9462-edc6ce399792 with Priority: HIGHEST for action port [ 1023.796813] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1023.796953] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1023.797076] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de68fb-baa0-4966-9462-edc6ce399792 with Priority: HIGHEST for action port [ 1023.797596] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.797724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.797789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.797994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.798395] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.799756] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.799870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.799959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.800154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.800483] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.800599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.800658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.800942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.801056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.801156] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.801892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-11de68fb-baa0-4966-9462-edc6ce399792 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.802009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.802082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.802234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.802309] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11de68fb-baa0-4966-9462-edc6ce399792',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.805477] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.111442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.111761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.111761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.112108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.112108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.112108] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1024.151420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.151597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.151687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.152009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.152199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.163428] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1024.304642] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.304845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.305228] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.306291] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11de68fb-baa0-4966-9462-edc6ce399792 with status ACTIVE [ 1024.306642] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.306792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.307648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.308025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.308463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.308584] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.308659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.308694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.308864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.308955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.309174] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.309328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.309328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.309482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.309558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.309853] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11de68fb-baa0-4966-9462-edc6ce399792 is going to be updated. [ 1024.311111] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.311260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.311315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.311447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.311866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.311926] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be updated. [ 1024.331450] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.331880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.331950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.332186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.332324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.332477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11de68fb-baa0-4966-9462-edc6ce399792" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.338204] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.338341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.338417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.338621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.338826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.352690] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: IN_PROGRESS for 2s [ 1024.811968] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.315294] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.315605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.315821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.316325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.316473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.316645] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1025.351092] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.351092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.351092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.351355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.351527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.360996] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1025.762127] env[69728]: INFO networking_nsxv3.common.synchronization [req-3f6c7e0d-a53b-4294-ba86-24a283fe1988 req-ba6319d0-84ae-41ef-8ba7-4da934cd77d7 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_members [ 1025.762747] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_members [ 1025.764910] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.765496] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.765616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.765711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.765919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.766045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.766186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.176757] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.176757] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.176757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.176757] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.272393] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.272393] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.272393] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 already deleted. [ 1026.272393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.363885] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 1026.363885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.463736] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.463998] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.464145] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.464418] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.464716] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.464924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.465086] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.465322] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.465470] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.465694] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.465811] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1026.465930] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1026.466053] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1026.466174] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1026.466285] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1026.466449] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1026.483773] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1026.484064] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1026.484309] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1026.484612] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.485160] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c063e967-5c44-43bc-889c-bd01fd5576fd taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.485450] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.485654] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.486049] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.486208] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c063e967-5c44-43bc-889c-bd01fd5576fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.680527] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.988738] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.988974] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.989123] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.989412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.989566] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.989728] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c063e967-5c44-43bc-889c-bd01fd5576fd not found, creating... [ 1026.989995] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.990175] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.990299] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.990530] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.990821] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.991183] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.991362] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.991491] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.991764] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.991891] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.991996] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c063e967-5c44-43bc-889c-bd01fd5576fd is going to be created. [ 1027.013277] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.013481] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.013612] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.013907] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.014149] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.014385] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.183339] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.371116] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1027.371347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.371580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.371855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.372153] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.372153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.372153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.374323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.374323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.374323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.374323] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.685564] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.685714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.685787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.686362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.686362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.686362] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1027.715452] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.715599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.715666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.715956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.716178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.725816] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1027.879098] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.879273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.879344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.879559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.879724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.879820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.879882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.880055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.880142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.880278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.880372] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.880489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.880585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.880753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.880898] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.880990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.881061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.881202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.881275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.881354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.881454] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.374216] env[69728]: INFO networking_nsxv3.common.synchronization [req-efc79a5a-d929-439b-833e-3eb933dca53f req-dd1c8ca3-f58c-494e-8435-3d3dc9364877 tempest-VolumesAdminNegativeTest-8298396 tempest-VolumesAdminNegativeTest-8298396-project-member] Enqueued Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_members [ 1028.375117] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9274321f-9360-470e-a510-f63db8b66689 with Priority: HIGHEST for action security_group_members [ 1028.375524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9274321f-9360-470e-a510-f63db8b66689 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.375684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.375773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.376029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.376221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.376491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.376594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.376798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.376915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.377093] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9274321f-9360-470e-a510-f63db8b66689',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.386515] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00587369-d416-4d4c-b7d8-d80624c5056b: rpc.has_security_group_logging(os_id): False [ 1028.404681] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.404834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.404924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.405176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.405271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.405506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.405613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.405677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.405830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.405913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.406121] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.406215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.406275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.406415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.406490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.406700] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.406786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.406852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.407181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.407260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.407351] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1028.463323] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.463472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.463530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.463782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.463947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.498216] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1028.746215] env[69728]: INFO networking_nsxv3.common.synchronization [req-9533cb24-931f-4c44-93af-cbb7d3d9cec5 req-8f45846e-656f-48d7-bbea-18f7a974d467 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1028.747316] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1028.747709] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.747843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.747915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.748141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.748297] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.748423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.748458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.748595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.748679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.748775] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.815337] env[69728]: INFO networking_nsxv3.common.synchronization [req-3f6c7e0d-a53b-4294-ba86-24a283fe1988 req-f490c0df-1830-4ecf-8e98-11702bb2d53e service nova] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_rules [ 1028.815534] env[69728]: INFO networking_nsxv3.common.synchronization [req-3f6c7e0d-a53b-4294-ba86-24a283fe1988 req-f490c0df-1830-4ecf-8e98-11702bb2d53e service nova] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_members [ 1028.817318] env[69728]: INFO networking_nsxv3.common.synchronization [req-3f6c7e0d-a53b-4294-ba86-24a283fe1988 req-f490c0df-1830-4ecf-8e98-11702bb2d53e service nova] Enqueued Resource ID: c063e967-5c44-43bc-889c-bd01fd5576fd with Priority: HIGHEST for action port [ 1028.817606] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_rules [ 1028.817803] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_members [ 1028.817932] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c063e967-5c44-43bc-889c-bd01fd5576fd with Priority: HIGHEST for action port [ 1028.818555] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.818766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.818877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.819134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.819258] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.820150] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.820304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.820376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.820569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.820815] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.820977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.821488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.821488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.821488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.821488] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.822387] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c063e967-5c44-43bc-889c-bd01fd5576fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.824148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.824148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.824148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.824148] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c063e967-5c44-43bc-889c-bd01fd5576fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.879388] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.879543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.879617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.879831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.879925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.880207] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.880283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.880314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.880471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.880547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.881175] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9274321f-9360-470e-a510-f63db8b66689 is going to be updated. [ 1028.905473] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.905612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.905677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.905897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.906079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.913480] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9274321f-9360-470e-a510-f63db8b66689 in Status: IN_PROGRESS for 2s [ 1029.251000] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.251000] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.251000] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.251230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.251321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.251522] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.251618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.251679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.251833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.251907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.251990] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1029.275835] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.276154] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.276234] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.276444] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.276703] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.277939] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.277939] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.277939] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.277939] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.278347] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.278638] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.278638] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.278916] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.279142] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1029.279336] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.279553] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.281919] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.282032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.282421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.282631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.282854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.295382] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1029.301138] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.301138] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1029.301138] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.301138] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.301690] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-47b166d8-04e1-409c-99ba-b2402c68db52 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.301967] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.302109] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.302448] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.302586] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47b166d8-04e1-409c-99ba-b2402c68db52',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.327781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.327781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.327781] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.327781] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c063e967-5c44-43bc-889c-bd01fd5576fd with status ACTIVE [ 1029.327781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.327781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.328068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.328068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.330161] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.330161] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.330161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.330161] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c063e967-5c44-43bc-889c-bd01fd5576fd is going to be updated. [ 1029.356995] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.357136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.357136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.357368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.357544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.357762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c063e967-5c44-43bc-889c-bd01fd5576fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.745062] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1029.745366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.746715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.746987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.747214] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.747337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.747421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.747600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.747686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.747777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.747939] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.748075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.748171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.748394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.748559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.748658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.748721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.752118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.752239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.752348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.752462] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.805095] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.805387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.805569] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.805891] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.806191] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.806766] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 47b166d8-04e1-409c-99ba-b2402c68db52 not found, creating... [ 1029.807261] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.807540] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.807784] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.808167] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.808436] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.808933] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.809229] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.809462] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.809794] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.810167] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.810318] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 47b166d8-04e1-409c-99ba-b2402c68db52 is going to be created. [ 1029.834347] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.834484] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.834613] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.835044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.835181] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.835423] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.837780] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.255214] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f791dd8-c5f7-4dee-8371-74dee670bd90: rpc.has_security_group_logging(os_id): False [ 1030.274605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.274605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.274605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.274811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.274811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.274953] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.275068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.275162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.275326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.275413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.276392] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.276708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.276708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.276855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.280020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.280020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.280020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.280020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.280020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.280020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.280020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1030.340575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.340958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.341059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.341322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.341729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.341729] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 is going to be created. [ 1030.350056] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.350056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.350260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.350319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.353025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.372277] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1030.374544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.374709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.374851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.375094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.375709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.403586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 in Status: UNINITIALIZED for 2s [ 1030.514422] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1030.514652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.924609] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9274321f-9360-470e-a510-f63db8b66689 in Status: SUCCESS [ 1030.924887] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9274321f-9360-470e-a510-f63db8b66689 deletion is rescheduled due to dependency. [ 1030.924941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9274321f-9360-470e-a510-f63db8b66689" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.985921] env[69728]: INFO networking_nsxv3.common.synchronization [req-9533cb24-931f-4c44-93af-cbb7d3d9cec5 req-2d3685d8-ac3e-40e2-8dbb-fa0c9f3ecdc0 service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 1030.985921] env[69728]: INFO networking_nsxv3.common.synchronization [req-9533cb24-931f-4c44-93af-cbb7d3d9cec5 req-2d3685d8-ac3e-40e2-8dbb-fa0c9f3ecdc0 service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1030.985921] env[69728]: INFO networking_nsxv3.common.synchronization [req-9533cb24-931f-4c44-93af-cbb7d3d9cec5 req-2d3685d8-ac3e-40e2-8dbb-fa0c9f3ecdc0 service nova] Enqueued Resource ID: 47b166d8-04e1-409c-99ba-b2402c68db52 with Priority: HIGHEST for action port [ 1030.985921] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 1030.985921] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1030.985921] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47b166d8-04e1-409c-99ba-b2402c68db52 with Priority: HIGHEST for action port [ 1030.985921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.986188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.987281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.987517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.987609] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.988483] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.988699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.989464] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-47b166d8-04e1-409c-99ba-b2402c68db52 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.989646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.989720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.989916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.990008] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47b166d8-04e1-409c-99ba-b2402c68db52',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.306893] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1031.307124] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 deletion is rescheduled due to dependency. [ 1031.307264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.307487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.307775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.308068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.308261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.308379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.308626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.308762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.308885] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.492134] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.492372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.492616] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47b166d8-04e1-409c-99ba-b2402c68db52 with status ACTIVE [ 1031.492784] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.492918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.492993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.493206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.493291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.493755] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.493872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.494058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.494176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.494176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.494441] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.494441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.494571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.494632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.494762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.494863] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47b166d8-04e1-409c-99ba-b2402c68db52 is going to be updated. [ 1031.519204] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.519353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.519439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.519636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.519774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.519941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47b166d8-04e1-409c-99ba-b2402c68db52" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.811110] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.314916] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.386749] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1032.386972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.387166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.387380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.387483] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.412874] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 in Status: SUCCESS [ 1032.413136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.413302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.413526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.413741] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.413878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.413952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.414152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.414236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.414346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.414440] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.819829] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.819829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.819829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.819829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.819829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.819829] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1032.847244] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.847669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.847893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.848115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.848321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.858021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1032.892930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.892930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.892930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.892930] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.917325] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.936251] env[69728]: INFO networking_nsxv3.common.synchronization [req-2907d67c-0401-4d94-91c9-bf193c2f4422 req-154c1863-54ea-4129-82cc-c029562b7c90 tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1032.936251] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1032.936251] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.936251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.936526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.936843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.937131] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.937370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.937551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.937807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.938113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.938309] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.258581] env[69728]: INFO networking_nsxv3.common.synchronization [req-6ebc0125-c802-47c3-ad60-b7ddd2d735d5 req-711ba186-779c-4371-8762-357240e41749 tempest-MultipleCreateTestJSON-1402620668 tempest-MultipleCreateTestJSON-1402620668-project-member] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1033.258581] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGHEST for action security_group_members [ 1033.258581] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.258581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.396266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.396630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.418631] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 744d58d1-f84e-4c36-b213-5dbf603203f4: rpc.has_security_group_logging(os_id): False [ 1033.436610] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.436805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.437602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.437602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.437602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.437602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.437823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.437823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.437980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.437980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.438074] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 is going to be created. [ 1033.442544] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.503852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.503852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.503852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.504906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.504906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.518509] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 in Status: IN_PROGRESS for 2s [ 1033.944257] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.449267] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.449267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.449267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.449267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.449267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.449267] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1034.477132] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.477132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.477132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.477132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.477132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.486151] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1034.866883] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1034.867188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.867349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.867554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.867744] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.867859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.867924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.868088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.868168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.868255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.868347] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.374479] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.531273] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 in Status: SUCCESS [ 1035.531725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.883783] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562643dd-522c-4927-b2ad-26c57a85d1e3: rpc.has_security_group_logging(os_id): False [ 1035.900762] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.900937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.901012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.901328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.901468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.901765] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.901876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.901942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.902156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.902246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.902376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1035.970444] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.970558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.970558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.973018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.973018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.985251] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1036.494766] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1036.495304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.495304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.495401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.495603] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.495718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.495773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.496742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.496742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.496742] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.998513] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.000392] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.000392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.000392] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1037.024088] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.024303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.024337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.024574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.024737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.034189] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1037.877886] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a97a2b26-cc7f-421c-934c-da7329c79eea None None] Enqueued Resource ID: f864510e-e548-4d0a-aa49-b5aa573e5cd5 with Priority: HIGHEST for action port [ 1037.879509] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f864510e-e548-4d0a-aa49-b5aa573e5cd5 with Priority: HIGHEST for action port [ 1037.879937] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f864510e-e548-4d0a-aa49-b5aa573e5cd5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.880284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f864510e-e548-4d0a-aa49-b5aa573e5cd5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.880402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f864510e-e548-4d0a-aa49-b5aa573e5cd5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.880792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f864510e-e548-4d0a-aa49-b5aa573e5cd5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.880937] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f864510e-e548-4d0a-aa49-b5aa573e5cd5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.001912] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1038.001912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.383609] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f864510e-e548-4d0a-aa49-b5aa573e5cd5 [ 1038.383609] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.387112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.387112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.387112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.387112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.387112] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f864510e-e548-4d0a-aa49-b5aa573e5cd5 already deleted. [ 1038.387112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f864510e-e548-4d0a-aa49-b5aa573e5cd5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.725609] env[69728]: INFO networking_nsxv3.common.synchronization [req-a0c94db7-91eb-4732-8705-9e90d311cd55 req-a488147f-fda3-4a1a-a1ba-37f294e5238f tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1038.729602] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1038.731279] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.732517] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.732517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.732853] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.046852] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1039.046852] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 deletion is rescheduled due to dependency. [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.046852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.046852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.046852] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.046852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.049756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.049756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.049756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.049756] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.236061] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.552378] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f791dd8-c5f7-4dee-8371-74dee670bd90: rpc.has_security_group_logging(os_id): False [ 1039.570113] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.570113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.570326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.570473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.570473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.570689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.570796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.570863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.571131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.571131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.571534] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.571534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.571534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.571651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.571834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.571991] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.576347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.576453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.576655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.576854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.576909] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be updated. [ 1039.636263] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.636419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.636499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.636678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.636827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.650793] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: IN_PROGRESS for 2s [ 1039.739444] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.241849] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.242199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.242199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.242342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.242431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.242531] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1040.268285] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.268569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.268647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.268869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.269028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.279528] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1040.355367] env[69728]: INFO networking_nsxv3.common.synchronization [req-5e9c7686-4ffd-4159-9039-b499ed8fdee0 req-55bf236b-6925-4fd1-8906-58e401b57baa tempest-ServersWithSpecificFlavorTestJSON-1321527697 tempest-ServersWithSpecificFlavorTestJSON-1321527697-project-member] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 1040.355367] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGHEST for action security_group_members [ 1040.355367] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.355531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.355531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.356207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.356207] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.356207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.356207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.356387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.356520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.356564] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.582064] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3d0a0e16-249a-47ef-ac5c-07b365395492 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1040.582064] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1040.582064] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.582064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.658588] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7142b676-f0a0-454e-b8ba-e4c441f74070 None None] Enqueued Resource ID: 42a428ba-240f-4b20-8086-ac229c062e19 with Priority: HIGHEST for action port [ 1040.658883] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a428ba-240f-4b20-8086-ac229c062e19 with Priority: HIGHEST for action port [ 1040.659234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a428ba-240f-4b20-8086-ac229c062e19 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.659355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a428ba-240f-4b20-8086-ac229c062e19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.659419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a428ba-240f-4b20-8086-ac229c062e19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.659754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a428ba-240f-4b20-8086-ac229c062e19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.659754] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a428ba-240f-4b20-8086-ac229c062e19',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.858218] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.858390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.858445] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.858655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.858750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.858948] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.859061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.859122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.859272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.859349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.859435] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be updated. [ 1040.883842] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.883992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.884114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.887558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.887558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.892125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: IN_PROGRESS for 2s [ 1041.162943] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42a428ba-240f-4b20-8086-ac229c062e19 [ 1041.163185] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.163411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.163411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.163628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.163717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.163809] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42a428ba-240f-4b20-8086-ac229c062e19 already deleted. [ 1041.163892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a428ba-240f-4b20-8086-ac229c062e19" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.665891] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 in Status: SUCCESS [ 1041.666144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.747487] env[69728]: INFO networking_nsxv3.common.synchronization [None req-756ad0ce-079a-4ee4-80e4-28736796177b tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: 0b09f60b-951e-433e-af9a-06d486b1d1e9 with Priority: HIGHEST for action security_group_rules [ 1041.747645] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b09f60b-951e-433e-af9a-06d486b1d1e9 with Priority: HIGHEST for action security_group_rules [ 1041.751036] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b09f60b-951e-433e-af9a-06d486b1d1e9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.751036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.751036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.751036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.751036] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b09f60b-951e-433e-af9a-06d486b1d1e9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.871174] env[69728]: INFO networking_nsxv3.common.synchronization [None req-c26ffa0b-abcb-448c-bdd7-43d1e23b5223 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: 0b09f60b-951e-433e-af9a-06d486b1d1e9 with Priority: HIGHEST for action security_group_rules [ 1041.872021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b09f60b-951e-433e-af9a-06d486b1d1e9 with Priority: HIGHEST for action security_group_rules [ 1041.873286] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b09f60b-951e-433e-af9a-06d486b1d1e9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.873439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.277573] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.277800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.278488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.278488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.278488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.278623] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b09f60b-951e-433e-af9a-06d486b1d1e9 already deleted. [ 1042.278674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.278857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.279062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.279140] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b09f60b-951e-433e-af9a-06d486b1d1e9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.290134] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1042.290372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.290581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.290861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.291091] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.291246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.291356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.291762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.291762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.291762] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.796646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.796646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.796646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.796646] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1042.802154] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.802226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.802347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.802461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.802580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.802633] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b09f60b-951e-433e-af9a-06d486b1d1e9 already deleted. [ 1042.802714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b09f60b-951e-433e-af9a-06d486b1d1e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.821315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.821662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.821784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.822045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.822236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.832573] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1042.903680] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 in Status: SUCCESS [ 1042.903680] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 deletion is rescheduled due to dependency. [ 1042.903680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.569944] env[69728]: INFO networking_nsxv3.common.synchronization [req-210aa2ac-8615-4ece-a559-afed308c023e req-6e7e046d-609b-42ef-a767-50dacb4f1875 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_members [ 1044.569944] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 with Priority: HIGHEST for action security_group_members [ 1044.570452] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-33bba7e4-2298-4997-b67a-a02ac1558aa5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.570528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.570642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.570798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.571187] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.571367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.571441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.571627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.571738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.571926] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33bba7e4-2298-4997-b67a-a02ac1558aa5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.841836] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1044.842205] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b deletion is rescheduled due to dependency. [ 1044.842522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.075974] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.076233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.076233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.076421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.076513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.076708] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.076814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.076881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.077023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.077320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.077320] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 is going to be updated. [ 1045.102715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.102715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.102826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.102996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.103243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.131966] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: IN_PROGRESS for 2s [ 1046.110042] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e3e14fc0-d8d1-4755-8ef5-e3ca66080f60 None None] Enqueued Resource ID: 7a88ed53-af86-4e82-a3c8-0f4d332845fa with Priority: HIGHEST for action port [ 1046.110279] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a88ed53-af86-4e82-a3c8-0f4d332845fa with Priority: HIGHEST for action port [ 1046.112335] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a88ed53-af86-4e82-a3c8-0f4d332845fa taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.112335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a88ed53-af86-4e82-a3c8-0f4d332845fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.112335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a88ed53-af86-4e82-a3c8-0f4d332845fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.112335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a88ed53-af86-4e82-a3c8-0f4d332845fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.112335] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a88ed53-af86-4e82-a3c8-0f4d332845fa',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.426104] env[69728]: INFO networking_nsxv3.common.synchronization [req-d32ea8d3-5288-4daf-aab7-f763f73112f3 req-99c83895-c4d0-4691-adb0-d0746a2d11eb tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1046.427033] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1046.427135] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.427216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.427305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.427495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.427659] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.427761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.427822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.427999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.428106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.428200] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.616795] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a88ed53-af86-4e82-a3c8-0f4d332845fa [ 1046.617042] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.617187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.617259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.617467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.617553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.617647] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a88ed53-af86-4e82-a3c8-0f4d332845fa already deleted. [ 1046.617729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a88ed53-af86-4e82-a3c8-0f4d332845fa" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.832993] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-24e31eb9-75bf-48cf-972d-ba90cf76dd7f tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1046.833478] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1046.833801] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.833940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.834076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.834493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.834493] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.834493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.834788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.834788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.834788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.834877] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.930165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.935534] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.935534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.935534] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1046.961173] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.961173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.961173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.961347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.961519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.969519] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1047.141576] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: IN_PROGRESS for 4s [ 1047.340292] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.340292] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.340292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.340292] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1047.360984] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-d3a2e75f-9f21-4b62-aa21-68756aed33b1 tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1047.361819] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1047.361975] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.362144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.364339] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.364511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.365648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.365648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.365648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.373424] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1047.897019] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-437" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-437" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-437" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.897019] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.897019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.897019] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.897642] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.897642] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.897708] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.897893] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.898011] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.898309] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.916480] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.916615] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.916762] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.917089] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-437" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.917414] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-88663201-ca30-4158-ab83-18ba1693769b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.917627] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.917727] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.918059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.918221] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88663201-ca30-4158-ab83-18ba1693769b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.420880] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.421284] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.421338] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.421601] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.421763] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.421916] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 88663201-ca30-4158-ab83-18ba1693769b not found, creating... [ 1048.422188] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.422346] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.422577] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.422756] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.422868] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.423173] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.423406] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.423461] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.423661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.423793] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.423944] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 88663201-ca30-4158-ab83-18ba1693769b is going to be created. [ 1048.444896] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.444896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.444896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.445271] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.445522] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.445789] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.458819] env[69728]: INFO networking_nsxv3.common.synchronization [None req-68091dac-80ae-4cf5-982b-050fdeea885e None None] Enqueued Resource ID: b9275e63-b648-49a1-8a3d-25f98b794c7e with Priority: HIGHEST for action port [ 1048.458819] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9275e63-b648-49a1-8a3d-25f98b794c7e with Priority: HIGHEST for action port [ 1048.458819] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9275e63-b648-49a1-8a3d-25f98b794c7e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.458819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9275e63-b648-49a1-8a3d-25f98b794c7e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.458819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9275e63-b648-49a1-8a3d-25f98b794c7e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.458819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9275e63-b648-49a1-8a3d-25f98b794c7e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.458819] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9275e63-b648-49a1-8a3d-25f98b794c7e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.960314] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9275e63-b648-49a1-8a3d-25f98b794c7e [ 1048.960556] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.960689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.960754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.960962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.961065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.961160] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9275e63-b648-49a1-8a3d-25f98b794c7e already deleted. [ 1048.961486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9275e63-b648-49a1-8a3d-25f98b794c7e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.978786] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1048.978786] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 1048.978786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.152434] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 in Status: SUCCESS [ 1049.152620] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33bba7e4-2298-4997-b67a-a02ac1558aa5 deletion is rescheduled due to dependency. [ 1049.152770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33bba7e4-2298-4997-b67a-a02ac1558aa5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.323493] env[69728]: INFO networking_nsxv3.common.synchronization [req-5a9d130a-3986-49c8-a920-c891ab91cf8d req-cd089f7d-4b9a-4e82-ace5-c256f187bd6c tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1049.323665] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1049.324017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.328020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.328020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.328020] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.383347] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1049.383535] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 deletion is rescheduled due to dependency. [ 1049.384120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.384120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.384729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.385116] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.385299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.386577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.386577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.386577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.386577] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.520602] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-471cf652-f1b4-4724-a30e-5bdeffd90ffe service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 1049.521499] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-471cf652-f1b4-4724-a30e-5bdeffd90ffe service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1049.523848] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-471cf652-f1b4-4724-a30e-5bdeffd90ffe service nova] Enqueued Resource ID: 88663201-ca30-4158-ab83-18ba1693769b with Priority: HIGHEST for action port [ 1049.523848] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 1049.523848] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1049.528574] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88663201-ca30-4158-ab83-18ba1693769b with Priority: HIGHEST for action port [ 1049.528574] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.528574] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.528574] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.528574] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-88663201-ca30-4158-ab83-18ba1693769b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.528574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.528574] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88663201-ca30-4158-ab83-18ba1693769b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.764443] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-902 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.764969] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.765138] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.765490] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.765756] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.765918] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.766054] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.766277] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.766451] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.766664] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.766780] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.766891] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.767033] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.767125] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1049.767234] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.767367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.785026] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.785026] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1049.785167] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.785326] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-902" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.785585] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-3d935da4-080b-4747-a36d-40b30ef0b659 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.785786] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.785886] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.786219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.786717] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d935da4-080b-4747-a36d-40b30ef0b659',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.832075] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.889372] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.029806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.029806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.035171] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88663201-ca30-4158-ab83-18ba1693769b with status ACTIVE [ 1050.035299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.035370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.035439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.035660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.035779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.035913] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.036018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.036082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.036236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.036314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.036492] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.036598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.036658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.036793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.036865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.036946] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88663201-ca30-4158-ab83-18ba1693769b is going to be updated. [ 1050.057892] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.058031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.058075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.058236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.058362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.058509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88663201-ca30-4158-ab83-18ba1693769b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.289660] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.289885] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.290037] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.290348] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.290564] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.290732] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 3d935da4-080b-4747-a36d-40b30ef0b659 not found, creating... [ 1050.290988] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.291183] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.291309] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.291534] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.291678] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.291963] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.292466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.292609] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.292831] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.292972] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.293176] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 3d935da4-080b-4747-a36d-40b30ef0b659 is going to be created. [ 1050.316036] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.317295] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.317466] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.317753] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.317990] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.318245] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.336504] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.359398] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-453 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.359619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-453" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.359757] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-453" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.360622] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-453" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.361138] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.361138] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.361234] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.363749] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.363749] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.363749] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.363749] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.363749] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.363749] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.363749] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.363749] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.363749] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.390523] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.390717] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1050.390852] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.391104] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-453" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.392705] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-eed558f1-272a-4cc5-b384-bfc6450e68c7 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.392705] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.392705] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.392705] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.392705] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed558f1-272a-4cc5-b384-bfc6450e68c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.408982] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.839026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.839026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.839026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.839026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.839026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.839026] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1050.865498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.865705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.865770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.865944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.866105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.876182] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1050.910576] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.910759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.910889] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.911317] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.911387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.911504] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port eed558f1-272a-4cc5-b384-bfc6450e68c7 not found, creating... [ 1050.911935] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.911935] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.913100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.913100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.913100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.913100] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.913100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.913100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.913327] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.913327] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.913487] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: eed558f1-272a-4cc5-b384-bfc6450e68c7 is going to be created. [ 1050.914802] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.914802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.914802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.914960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.915051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.917032] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1050.937350] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.937350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.937350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.937350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.937350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.937350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.944132] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.944132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.944132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.944132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.944132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.952372] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1051.124440] env[69728]: INFO networking_nsxv3.common.synchronization [req-5a9d130a-3986-49c8-a920-c891ab91cf8d req-620c8c8c-4d01-448c-a399-d7eb03b65a1f service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 1051.124687] env[69728]: INFO networking_nsxv3.common.synchronization [req-5a9d130a-3986-49c8-a920-c891ab91cf8d req-620c8c8c-4d01-448c-a399-d7eb03b65a1f service nova] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1051.125406] env[69728]: INFO networking_nsxv3.common.synchronization [req-5a9d130a-3986-49c8-a920-c891ab91cf8d req-620c8c8c-4d01-448c-a399-d7eb03b65a1f service nova] Enqueued Resource ID: 3d935da4-080b-4747-a36d-40b30ef0b659 with Priority: HIGHEST for action port [ 1051.125852] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_rules [ 1051.126264] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1051.127461] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d935da4-080b-4747-a36d-40b30ef0b659 with Priority: HIGHEST for action port [ 1051.127461] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.127461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.127461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.127461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.128312] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.129153] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.129316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.129570] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d935da4-080b-4747-a36d-40b30ef0b659 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.129739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.129845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.130140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.130197] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d935da4-080b-4747-a36d-40b30ef0b659',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.632878] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.633038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.633268] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d935da4-080b-4747-a36d-40b30ef0b659 with status ACTIVE [ 1051.633444] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.633553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.633620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.633816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.633903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.634082] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.634175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.634242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.634472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.634538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.634673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.634765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.634825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.634963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.635041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.635125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d935da4-080b-4747-a36d-40b30ef0b659 is going to be updated. [ 1051.653739] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.653817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.653851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.654027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.654359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.654359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d935da4-080b-4747-a36d-40b30ef0b659" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.731900] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-d700605c-3f57-4855-ade0-2b12697a9e4a service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 1051.732105] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-d700605c-3f57-4855-ade0-2b12697a9e4a service nova] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1051.732251] env[69728]: INFO networking_nsxv3.common.synchronization [req-28216edf-93d9-49fc-bad6-a5f1a1610cd4 req-d700605c-3f57-4855-ade0-2b12697a9e4a service nova] Enqueued Resource ID: eed558f1-272a-4cc5-b384-bfc6450e68c7 with Priority: HIGHEST for action port [ 1051.732480] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_rules [ 1051.732610] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1051.732706] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed558f1-272a-4cc5-b384-bfc6450e68c7 with Priority: HIGHEST for action port [ 1051.733754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.733865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.734888] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.736186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.736186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-eed558f1-272a-4cc5-b384-bfc6450e68c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.736186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.736186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.736186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.736186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed558f1-272a-4cc5-b384-bfc6450e68c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.237506] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eed558f1-272a-4cc5-b384-bfc6450e68c7 with status ACTIVE [ 1052.237741] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.237847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.237921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.238150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.238245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.238435] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.238538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.238601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.238749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.238825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.239007] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.239107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.239184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.239390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.239470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.239559] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eed558f1-272a-4cc5-b384-bfc6450e68c7 is going to be updated. [ 1052.258161] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.258330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.258369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.259166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.259166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.259166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eed558f1-272a-4cc5-b384-bfc6450e68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.887864] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1052.888097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.888279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.888530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.888715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.888836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.888914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.889078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.889161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.889260] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.962490] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1052.962779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.963029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.963311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.963547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.963647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.963758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.963973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.964075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.964196] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.266937] env[69728]: INFO networking_nsxv3.common.synchronization [None req-4b04a99c-8bbf-41fc-ba29-da6541f5f948 None None] Enqueued Resource ID: 2bea4b1b-de62-4251-b68c-db04979bb092 with Priority: HIGHEST for action port [ 1053.267349] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bea4b1b-de62-4251-b68c-db04979bb092 with Priority: HIGHEST for action port [ 1053.267827] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bea4b1b-de62-4251-b68c-db04979bb092 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.267967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bea4b1b-de62-4251-b68c-db04979bb092" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.268390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bea4b1b-de62-4251-b68c-db04979bb092" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.268666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bea4b1b-de62-4251-b68c-db04979bb092" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.268770] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bea4b1b-de62-4251-b68c-db04979bb092',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.393139] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.467888] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.770698] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bea4b1b-de62-4251-b68c-db04979bb092 [ 1053.770940] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.771081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.771151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.771591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.771591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.771591] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bea4b1b-de62-4251-b68c-db04979bb092 already deleted. [ 1053.771762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bea4b1b-de62-4251-b68c-db04979bb092" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.897029] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.971339] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.402128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.402128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.402128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.402128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.402128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.402128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1054.430122] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.430279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.430353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.430562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.430707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.438986] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1054.474151] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.474330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.474400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.474612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.474704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.474801] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1054.503323] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.503464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.503531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.503735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.503880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.513744] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1054.870557] env[69728]: INFO networking_nsxv3.common.synchronization [req-2af46aab-79aa-44ce-ac38-5ac7f30339b0 req-c7e9948e-4784-48d8-a390-026b659dc25d tempest-MigrationsAdminTest-770467406 tempest-MigrationsAdminTest-770467406-project-member] Enqueued Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 1054.871126] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 with Priority: HIGHEST for action security_group_members [ 1054.871464] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-954e79e4-ed41-40fb-8699-8b26721b1d77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.871590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.871658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.871850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.876122] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.876122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.876122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.876298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.876388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.876537] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('954e79e4-ed41-40fb-8699-8b26721b1d77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.381322] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.381322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.381322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.381322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.399922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.400280] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.400454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.400572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.400836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.400948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.401088] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 is going to be updated. [ 1055.424370] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.424671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.424671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.424804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.424942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.433344] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: IN_PROGRESS for 2s [ 1055.702316] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e8a5b583-22df-4b75-bc3f-53daf05bc23d None None] Enqueued Resource ID: 147ef828-91a7-47ce-9d8e-3ccfa85a0142 with Priority: HIGHEST for action port [ 1055.702567] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 147ef828-91a7-47ce-9d8e-3ccfa85a0142 with Priority: HIGHEST for action port [ 1055.704017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-147ef828-91a7-47ce-9d8e-3ccfa85a0142 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.704017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-147ef828-91a7-47ce-9d8e-3ccfa85a0142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.704017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-147ef828-91a7-47ce-9d8e-3ccfa85a0142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.704017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-147ef828-91a7-47ce-9d8e-3ccfa85a0142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.704324] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('147ef828-91a7-47ce-9d8e-3ccfa85a0142',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.738467] env[69728]: INFO networking_nsxv3.common.synchronization [req-1237ded5-ab52-4a3d-893e-ff9dad09af17 req-ce94621d-ee65-4b98-bd2e-da832dc0392c tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 1055.740194] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 1055.740194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.740194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.740194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.740194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.740402] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.740482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.740569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.740789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.740870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.741011] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.205821] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 147ef828-91a7-47ce-9d8e-3ccfa85a0142 [ 1056.206054] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.206194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.206267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.206477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.206570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.206666] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:147ef828-91a7-47ce-9d8e-3ccfa85a0142 already deleted. [ 1056.206748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-147ef828-91a7-47ce-9d8e-3ccfa85a0142" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.243936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.244091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.244166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.244412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.244506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.244701] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.244801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.244891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.245027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.245107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.245192] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 1056.274772] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.274920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.274993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.275231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.275365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.284206] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 1056.428356] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-72 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.428666] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.428729] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.428955] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.429232] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.429396] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.429522] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.429740] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.429889] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.430522] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.430673] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.430794] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.430911] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.431041] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1056.431155] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.431401] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.451019] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1056.451274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.451428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.451632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.451820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.451933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.452000] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.452170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.452256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.452343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.452435] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.458882] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.459020] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1056.459165] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.459341] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.459656] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-3adc8580-af3e-40df-a623-6d42435cd91c taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.459835] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.459961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.460339] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.460483] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3adc8580-af3e-40df-a623-6d42435cd91c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.523449] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.523449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.523449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.523449] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.524783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.524976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.525260] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.525395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.525462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.525741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.525853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.525954] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.954931] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.955122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.955193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.955415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.955637] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.955754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.955818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.955975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.956067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.956158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.956438] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.956438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.956438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.956637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.956705] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.956789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.956838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.956991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.957084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.957166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.957261] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.962624] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.962896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.963054] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.963356] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.963524] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.963666] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 3adc8580-af3e-40df-a623-6d42435cd91c not found, creating... [ 1056.963944] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.964144] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.964278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.964495] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.964634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.964935] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.965439] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.965611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.965837] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.965982] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.966142] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 3adc8580-af3e-40df-a623-6d42435cd91c is going to be created. [ 1056.987239] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.987465] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.987594] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.987886] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.988143] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.988375] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.027933] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.029360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.029540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.442996] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 in Status: SUCCESS [ 1057.443321] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 954e79e4-ed41-40fb-8699-8b26721b1d77 deletion is rescheduled due to dependency. [ 1057.443321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-954e79e4-ed41-40fb-8699-8b26721b1d77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.459911] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7481a9f3-6d05-4af7-91aa-204c1c681418: rpc.has_security_group_logging(os_id): False [ 1057.476571] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.476771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.476850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.477160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.477293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.477593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.477757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.477835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.478061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.478156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.478403] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.478517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.478561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.478741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.478822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.480055] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.480055] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.480305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.480305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.480305] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1057.533426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.538361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.538562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.538658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.539087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.539171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.553116] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1057.763475] env[69728]: INFO networking_nsxv3.common.synchronization [req-1237ded5-ab52-4a3d-893e-ff9dad09af17 req-f6cd17fc-bf01-46e4-9759-5d6de07c3af1 service nova] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_rules [ 1057.763654] env[69728]: INFO networking_nsxv3.common.synchronization [req-1237ded5-ab52-4a3d-893e-ff9dad09af17 req-f6cd17fc-bf01-46e4-9759-5d6de07c3af1 service nova] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 1057.763799] env[69728]: INFO networking_nsxv3.common.synchronization [req-1237ded5-ab52-4a3d-893e-ff9dad09af17 req-f6cd17fc-bf01-46e4-9759-5d6de07c3af1 service nova] Enqueued Resource ID: 3adc8580-af3e-40df-a623-6d42435cd91c with Priority: HIGHEST for action port [ 1057.764178] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_rules [ 1057.764356] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 1057.764500] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3adc8580-af3e-40df-a623-6d42435cd91c with Priority: HIGHEST for action port [ 1057.765077] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.765204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.765273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.765532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.765604] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.768544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.768544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.768544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3adc8580-af3e-40df-a623-6d42435cd91c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.768544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.768544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.768544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.768544] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3adc8580-af3e-40df-a623-6d42435cd91c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.035911] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.036136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.036239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.036422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.036517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.036635] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1058.071627] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.071790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.072420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.072687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.073943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.083670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1058.268566] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.269602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.269870] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3adc8580-af3e-40df-a623-6d42435cd91c with status ACTIVE [ 1058.270088] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.270217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.270282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.270499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.270588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.270767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.270862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.270943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.271183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.271322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.271605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.271744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.271860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.272074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.272192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.272319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3adc8580-af3e-40df-a623-6d42435cd91c is going to be updated. [ 1058.297090] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.297090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.297090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.297370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.298139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.298139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3adc8580-af3e-40df-a623-6d42435cd91c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.302088] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 1058.302280] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda deletion is rescheduled due to dependency. [ 1058.302413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.302629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.303602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.303602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.303602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.303602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.303602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.303602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.303602] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.669189] env[69728]: INFO networking_nsxv3.common.synchronization [req-d472cb8d-8a59-4f63-a0c2-c62c2262c64e req-7d11b5be-ac1a-44b3-855c-4e1f048ad347 tempest-VolumesAdminNegativeTest-8298396 tempest-VolumesAdminNegativeTest-8298396-project-member] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_members [ 1058.670693] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGHEST for action security_group_members [ 1058.670693] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.670693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.670693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.670693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.670693] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.670693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.670693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.671134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.671134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.671134] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.774708] env[69728]: INFO networking_nsxv3.common.synchronization [req-2346e374-73a8-46e0-a5b4-d249b051dde8 req-8c1eeb8e-dd94-459e-a862-467166f1c89d tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1058.775958] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1058.776452] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.776825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.778058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.778058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.778058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.778058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.778058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.778505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.778704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.779133] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.805859] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.181259] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.181259] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.181259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.181259] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf is going to be updated. [ 1059.239563] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.239563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.239563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.239563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.239563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.248330] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: IN_PROGRESS for 2s [ 1059.281889] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.308938] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.487018] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.487585] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.487777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.488336] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.488676] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.489129] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.489395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.490250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.490555] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.491069] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.491261] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.491458] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.491656] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.491831] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1059.492179] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.492453] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.512130] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.512316] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1059.512463] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.512647] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.512968] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-01d6ba5f-19b9-4be3-b251-f17008d274a0 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.513173] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.513314] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.513661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.513814] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01d6ba5f-19b9-4be3-b251-f17008d274a0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.569590] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1059.569590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.800122] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.812032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.812032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.812032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.812032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.812032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.812325] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 1059.844284] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.844284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.844284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.844284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.844284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.854370] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 1060.016581] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.016931] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.017101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.017411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.017573] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.017737] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 01d6ba5f-19b9-4be3-b251-f17008d274a0 not found, creating... [ 1060.018028] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.018200] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.018325] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.018559] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.018703] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.018997] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.019456] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.019456] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.019575] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.019747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.019810] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 01d6ba5f-19b9-4be3-b251-f17008d274a0 is going to be created. [ 1060.043711] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.043958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.044114] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.044442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.044709] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.044913] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.093644] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1060.093983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.094247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.094713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.094907] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.095362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.095362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.095580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.095682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.095770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.096152] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.096295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.096295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.096588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.096820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.096983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.097093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.097420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.097539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.097701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.097807] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.287047] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.287231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.287305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.287527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.287621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.287757] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1060.315241] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.315241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.315241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.315392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.315480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.324726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1060.600423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70069c08-99e8-48a7-8c3c-59be136e7340: rpc.has_security_group_logging(os_id): False [ 1060.617235] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.617420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.617499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.617660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.617858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.618101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.618218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.618282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.618439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.618532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.618732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.618827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.618891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.619038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.619117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.619299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.619411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.619479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.619635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.619705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.619778] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1060.678225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.678441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.678524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.678731] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.678874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.696369] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1061.261158] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4195a4b3-a062-447e-88f8-e19488536bcf in Status: SUCCESS [ 1061.261492] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf deletion is rescheduled due to dependency. [ 1061.261492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.473901] env[69728]: INFO networking_nsxv3.common.synchronization [req-2346e374-73a8-46e0-a5b4-d249b051dde8 req-c684b8a3-230d-4e16-9459-a81f21e88a50 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 1061.473901] env[69728]: INFO networking_nsxv3.common.synchronization [req-2346e374-73a8-46e0-a5b4-d249b051dde8 req-c684b8a3-230d-4e16-9459-a81f21e88a50 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1061.474051] env[69728]: INFO networking_nsxv3.common.synchronization [req-2346e374-73a8-46e0-a5b4-d249b051dde8 req-c684b8a3-230d-4e16-9459-a81f21e88a50 service nova] Enqueued Resource ID: 01d6ba5f-19b9-4be3-b251-f17008d274a0 with Priority: HIGHEST for action port [ 1061.474570] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 1061.474714] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1061.474817] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d6ba5f-19b9-4be3-b251-f17008d274a0 with Priority: HIGHEST for action port [ 1061.475120] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.475287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.475368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.475583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.475681] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.476981] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.477102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.477410] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-01d6ba5f-19b9-4be3-b251-f17008d274a0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.477410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.477537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.477656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.477743] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01d6ba5f-19b9-4be3-b251-f17008d274a0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.866699] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.866699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.866699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.866699] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.979834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.979968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.986487] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01d6ba5f-19b9-4be3-b251-f17008d274a0 with status ACTIVE [ 1061.987602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.987602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.987602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.987602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.987602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.987602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.987602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.987602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.988075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.988075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.988075] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.988075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.988075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.988222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.988265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.988362] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01d6ba5f-19b9-4be3-b251-f17008d274a0 is going to be updated. [ 1062.014456] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.014611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.014687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.015089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.015089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.015259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01d6ba5f-19b9-4be3-b251-f17008d274a0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.335973] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1062.336276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.336401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.336626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.336812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.336943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.337023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.337214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.337310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.337387] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.370704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.370704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.370704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.370946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.370946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.371044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.371112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.371282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.371352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.371523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.371579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.371685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.371749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.371931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.372084] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.372178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.372308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.372394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.372470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.372558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.372655] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.713462] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1062.713462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.713462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.713462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.713462] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.842213] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.875678] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05a124ad-1f1b-4827-93f7-8088f013edda: rpc.has_security_group_logging(os_id): False [ 1062.892353] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.892509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.892607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.892828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.892921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.893159] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.893260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.893350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.893508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.893627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.893812] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.893899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.894045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.894126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.894223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.894380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.894480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.894531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.894704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.894802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.894891] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 1062.955068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.955234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.955309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.955992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.955992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.968735] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 1063.218580] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.218580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.218580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.218777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.218854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.218961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.219040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.219191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.219280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.219373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.219463] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.344694] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.722278] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.722603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.722603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.725299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.725498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.725610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.725679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.725842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.725929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.726035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.726189] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.726283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.726344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.726487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.726624] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.726715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.726777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.726912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.726988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.727081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.727171] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.853594] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.853776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.853848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.854107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.854203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.854304] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1063.890911] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.891070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.891140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.891499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.891668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.913741] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1064.231119] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70069c08-99e8-48a7-8c3c-59be136e7340: rpc.has_security_group_logging(os_id): False [ 1064.249428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.249428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.249428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.249428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.249950] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.249950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.249950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.250364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.250583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.250788] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1064.314459] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.314459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.314459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.314459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.314459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.329905] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1064.985389] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 1064.985690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.928074] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1065.928074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.928074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.928074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.928304] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.928388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.928457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.928622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.928715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.928774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.928867] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.345181] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1066.345464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.431188] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.431439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.431439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.431705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.431979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.431979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.432100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.432185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.432301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.432388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.432543] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.432636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.432696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.432838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.433488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.433488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.433488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.433488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.433488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.433488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.434835] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.475161] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1066.475308] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1066.824031] env[69728]: INFO networking_nsxv3.common.synchronization [req-69d0fd72-9b8d-47a4-a34b-7a9d7f8e165b req-de96da94-9031-4109-8047-ad649eb4c627 tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1066.824646] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1066.824996] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.825156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.825323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.825410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.825602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.825712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.825770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.825914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.826022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.826123] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.935650] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4864eea1-2a57-4824-a279-fb7f17aef5fd: rpc.has_security_group_logging(os_id): False [ 1066.955570] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.955740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.955803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.955997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.956103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.956298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.956404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.956455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.956986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.957091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.957578] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.957578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.957578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.957578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.957732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.957854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.957949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.960571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.960571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.960571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.960571] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1067.025657] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.025657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.025657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.025858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.027250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.042408] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1067.123973] env[69728]: INFO networking_nsxv3.common.synchronization [req-69d0fd72-9b8d-47a4-a34b-7a9d7f8e165b req-bc124c69-b31c-4b85-a56d-554064ecf696 tempest-ServersTestMultiNic-1379544549 tempest-ServersTestMultiNic-1379544549-project-member] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1067.124571] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGHEST for action security_group_members [ 1067.125728] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.125919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.328360] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.830675] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.153349] env[69728]: INFO networking_nsxv3.common.synchronization [req-33ab2b44-1c4d-40f9-bf07-bdbcc8394590 req-3b8108fa-ccc1-4f79-84a3-e4c34fb3e4b3 tempest-ServersTestBootFromVolume-645943446 tempest-ServersTestBootFromVolume-645943446-project-member] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_members [ 1068.153886] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGHEST for action security_group_members [ 1068.154206] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.154584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.154584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.154686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.154780] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.154857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.154905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.155476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.155598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.155730] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.333869] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.334071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.334071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.334268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.334348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.334442] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1068.362024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.362024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.362024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.362024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.362024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.370692] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1068.659575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.659575] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.659575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.660173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.660173] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d is going to be updated. [ 1068.686878] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.687072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.687259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.688422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.688422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.697821] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d in Status: IN_PROGRESS for 2s [ 1069.003137] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4b40407-d16a-4340-9704-a6fd55851be0 req-145b2243-ae32-4524-bbcd-3e2949556c4d tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1069.008064] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1069.009024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.010532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.010532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.010532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.010532] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.010532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.010532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.010532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.010970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.010970] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.058015] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1069.058281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.514227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.514398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.514501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.514742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.514843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.515100] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.515166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.515230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.515388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.515931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.515931] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1069.543457] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.543876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.544117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.544395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.548026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.552736] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1069.979927] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.982128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.982128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.982128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.982128] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.984895] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.985132] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.985411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.985560] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.985822] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.985918] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.986123] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.986195] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.986252] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1069.986359] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.986502] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.006810] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.007189] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.007189] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.007379] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.007727] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-c3f7eec1-62c6-4dd4-b259-450ff0455df2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.007935] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.008071] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.008442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.008621] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f7eec1-62c6-4dd4-b259-450ff0455df2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.380845] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1070.381257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.381420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.381594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.381835] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.382029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.382085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.382228] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.382324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.382426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.511560] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.512024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.512264] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.512602] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.512712] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.512911] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port c3f7eec1-62c6-4dd4-b259-450ff0455df2 not found, creating... [ 1070.513223] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.513373] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.513543] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.513867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.518829] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.519238] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.519471] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.519638] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.520145] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.520361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.520556] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: c3f7eec1-62c6-4dd4-b259-450ff0455df2 is going to be created. [ 1070.539209] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.539679] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.539823] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.540221] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.540574] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.540693] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.708559] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d in Status: SUCCESS [ 1070.708559] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d deletion is rescheduled due to dependency. [ 1070.708559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.737648] env[69728]: INFO networking_nsxv3.common.synchronization [req-025c4aec-6ff1-49f9-bdbb-f7a9bc53c6fa req-0d1d056f-72f8-43b4-83f7-782ea5125442 tempest-ImagesOneServerNegativeTestJSON-1753676722 tempest-ImagesOneServerNegativeTestJSON-1753676722-project-member] Enqueued Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 1070.741449] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05a124ad-1f1b-4827-93f7-8088f013edda with Priority: HIGHEST for action security_group_members [ 1070.741449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-05a124ad-1f1b-4827-93f7-8088f013edda taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.741449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.741449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.741449] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05a124ad-1f1b-4827-93f7-8088f013edda',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.884724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.884889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.884953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.885217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.885298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.885548] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.885782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.885782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.885906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.885978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.886077] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be updated. [ 1070.936774] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.936925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.936925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.937643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.937643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.946997] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: IN_PROGRESS for 2s [ 1071.243743] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.244060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.244060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.244241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.244337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.244569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.244702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.244771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.244930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.245014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.245107] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda is going to be updated. [ 1071.272748] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.272887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.272959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.273244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.273324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.283796] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: IN_PROGRESS for 2s [ 1071.532638] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4b40407-d16a-4340-9704-a6fd55851be0 req-4c938682-a78b-44fa-a365-2f3f82617229 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 1071.532877] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4b40407-d16a-4340-9704-a6fd55851be0 req-4c938682-a78b-44fa-a365-2f3f82617229 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1071.533063] env[69728]: INFO networking_nsxv3.common.synchronization [req-c4b40407-d16a-4340-9704-a6fd55851be0 req-4c938682-a78b-44fa-a365-2f3f82617229 service nova] Enqueued Resource ID: c3f7eec1-62c6-4dd4-b259-450ff0455df2 with Priority: HIGHEST for action port [ 1071.533601] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 1071.533820] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1071.533944] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3f7eec1-62c6-4dd4-b259-450ff0455df2 with Priority: HIGHEST for action port [ 1071.534279] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.534674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.534769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.534977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.535072] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.535914] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.536039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.536244] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3f7eec1-62c6-4dd4-b259-450ff0455df2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.536675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.536752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.536946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.537038] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3f7eec1-62c6-4dd4-b259-450ff0455df2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.561629] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1071.561857] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 1071.561936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.562395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.562634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.562833] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.562952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.563031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.563185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.563367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.563367] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.039108] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.039108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043399] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3f7eec1-62c6-4dd4-b259-450ff0455df2 with status ACTIVE [ 1072.043399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.043399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.043399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.043399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.043399] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3f7eec1-62c6-4dd4-b259-450ff0455df2 is going to be updated. [ 1072.063442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.063648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.063728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.063945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.064104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.064269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3f7eec1-62c6-4dd4-b259-450ff0455df2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.066701] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.084393] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3c85ff3e-b12b-4718-9ff0-d6bf9f9db8d8 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1072.085921] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1072.087360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.087360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.087360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.087360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.087777] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.181185] env[69728]: INFO networking_nsxv3.common.synchronization [None req-fe6fdac6-9887-4d7b-903e-026512b9aa8a tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1072.181810] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1072.182160] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.182272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.569072] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.606684] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.606828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.606901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.607157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.607255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.607517] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8408d52-084d-4902-9059-c9e45aefc511 already deleted. [ 1072.607517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.607631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.607738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.607823] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.958179] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70069c08-99e8-48a7-8c3c-59be136e7340 in Status: SUCCESS [ 1072.958179] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 deletion is rescheduled due to dependency. [ 1072.958179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.073927] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.073927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.073927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.073927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.073927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.073927] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1073.099999] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.099999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.099999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.099999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.099999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.106836] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1073.126944] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.128526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.128526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.128526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.128526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.128526] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8408d52-084d-4902-9059-c9e45aefc511 already deleted. [ 1073.128526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.293466] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05a124ad-1f1b-4827-93f7-8088f013edda in Status: SUCCESS [ 1073.293731] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05a124ad-1f1b-4827-93f7-8088f013edda deletion is rescheduled due to dependency. [ 1073.293847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05a124ad-1f1b-4827-93f7-8088f013edda" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.830613] env[69728]: INFO networking_nsxv3.common.synchronization [req-b8ff25cd-ddf2-4705-af5c-bd79ba55d53d req-0d2c3200-0cad-46e3-a2b3-cd40d6301273 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1073.831170] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1073.831499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.831625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.831695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.831946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.832138] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.832243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.832386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.832462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.832548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.832646] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.338360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.338360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.338360] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba already deleted. [ 1074.338360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.563900] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.564989] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.564989] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.564989] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.564989] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.565158] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.565320] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.565585] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.565652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.567741] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.567901] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.568035] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.568154] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.568283] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1074.568400] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.568545] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.596252] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.596252] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1074.596252] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.596558] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.596795] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-24229246-67b5-4241-a90a-22eb8ef68053 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.596917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.597674] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.597674] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.597674] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24229246-67b5-4241-a90a-22eb8ef68053',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.100104] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.100394] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.100449] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.102020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.102020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.102020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 24229246-67b5-4241-a90a-22eb8ef68053 not found, creating... [ 1075.102020] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.102020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.102020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.102020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.102020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.102634] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.102634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.102634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.102634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.102831] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.102897] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 24229246-67b5-4241-a90a-22eb8ef68053 is going to be created. [ 1075.115586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.118086] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.118086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.118086] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.123552] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.123917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.124079] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.124350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.124664] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.128018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.461018] env[69728]: INFO networking_nsxv3.common.synchronization [None req-65c7700f-de8c-43da-bf2f-a5d7db313d09 None None] Enqueued Resource ID: dd22c0ae-5c86-47f2-a8c2-29a39b3a66be with Priority: HIGHEST for action port [ 1075.461018] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd22c0ae-5c86-47f2-a8c2-29a39b3a66be with Priority: HIGHEST for action port [ 1075.461018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd22c0ae-5c86-47f2-a8c2-29a39b3a66be taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.461018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd22c0ae-5c86-47f2-a8c2-29a39b3a66be" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.461018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd22c0ae-5c86-47f2-a8c2-29a39b3a66be" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.461419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd22c0ae-5c86-47f2-a8c2-29a39b3a66be" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.461587] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd22c0ae-5c86-47f2-a8c2-29a39b3a66be',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.619581] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.622845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.622845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.622845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.622845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.623624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.623624] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.967029] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd22c0ae-5c86-47f2-a8c2-29a39b3a66be [ 1075.967124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.967907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.967907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.967907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.967907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.967907] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd22c0ae-5c86-47f2-a8c2-29a39b3a66be already deleted. [ 1075.967907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd22c0ae-5c86-47f2-a8c2-29a39b3a66be" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.125192] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc: rpc.has_security_group_logging(os_id): False [ 1076.142051] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.142223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.142296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.142530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.142631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.142866] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.143657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.143774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.143946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.144030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.144267] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.144359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.144428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.144570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.144647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.145371] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.145505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.145723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.145903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.146371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.146371] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1076.205349] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.205501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.205575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.205786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.205949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.220132] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1076.267627] env[69728]: INFO networking_nsxv3.common.synchronization [req-b8ff25cd-ddf2-4705-af5c-bd79ba55d53d req-24c8008f-f493-42df-ab95-c4bfe9019ecd service nova] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_rules [ 1076.267817] env[69728]: INFO networking_nsxv3.common.synchronization [req-b8ff25cd-ddf2-4705-af5c-bd79ba55d53d req-24c8008f-f493-42df-ab95-c4bfe9019ecd service nova] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1076.267959] env[69728]: INFO networking_nsxv3.common.synchronization [req-b8ff25cd-ddf2-4705-af5c-bd79ba55d53d req-24c8008f-f493-42df-ab95-c4bfe9019ecd service nova] Enqueued Resource ID: 24229246-67b5-4241-a90a-22eb8ef68053 with Priority: HIGHEST for action port [ 1076.272669] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_rules [ 1076.272876] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1076.272987] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24229246-67b5-4241-a90a-22eb8ef68053 with Priority: HIGHEST for action port [ 1076.273676] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.273743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.273835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.274070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.274161] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.275049] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.275167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.275229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.275407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.275552] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.275647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.275712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.275866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.275942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.278545] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.279364] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-24229246-67b5-4241-a90a-22eb8ef68053 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.279480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.279532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.279677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.279753] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24229246-67b5-4241-a90a-22eb8ef68053',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.758962] env[69728]: INFO networking_nsxv3.common.synchronization [req-93372df4-766e-46b1-b939-bd7855718bde req-55f6c476-d597-4c08-827a-0443e4f906d9 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1076.759771] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1076.760373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.760486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.781099] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.781240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.781785] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.782332] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24229246-67b5-4241-a90a-22eb8ef68053 with status ACTIVE [ 1076.782505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.782616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.782680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.783371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.783371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.783371] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.783371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.783371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.783564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.783564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.783700] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.784325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.784325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.784325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.784525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.784525] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24229246-67b5-4241-a90a-22eb8ef68053 is going to be updated. [ 1076.803139] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.803305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.803377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.803591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.803800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.803972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24229246-67b5-4241-a90a-22eb8ef68053" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.286500] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.595064] env[69728]: INFO networking_nsxv3.common.synchronization [None req-38f9fe25-c42c-4e9f-bcaa-b126e5f1ba56 None None] Enqueued Resource ID: 9a5d12a9-8fd1-41d2-8133-fab665012e31 with Priority: HIGHEST for action port [ 1077.595594] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a5d12a9-8fd1-41d2-8133-fab665012e31 with Priority: HIGHEST for action port [ 1077.595906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a5d12a9-8fd1-41d2-8133-fab665012e31 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.596069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a5d12a9-8fd1-41d2-8133-fab665012e31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.596403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a5d12a9-8fd1-41d2-8133-fab665012e31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.596403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a5d12a9-8fd1-41d2-8133-fab665012e31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.596518] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a5d12a9-8fd1-41d2-8133-fab665012e31',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.753877] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.753996] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.754143] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.754427] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.754737] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.754857] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.754969] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.758376] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.758558] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.758790] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.758967] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.759043] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.759162] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.759280] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.759392] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.759534] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.777658] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.777846] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.777993] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.778200] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.778528] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-a9a88587-478e-4d68-b921-c5eeb55e0a1e taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.778709] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.778826] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.779201] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.779371] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9a88587-478e-4d68-b921-c5eeb55e0a1e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.789295] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.789295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.789424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.789555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.789649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.789748] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be created. [ 1077.811728] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.811728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.811728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.811728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.811728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.821218] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: UNINITIALIZED for 2s [ 1078.105825] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a5d12a9-8fd1-41d2-8133-fab665012e31 [ 1078.106068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.106195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.106258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.106465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.106546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.106637] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a5d12a9-8fd1-41d2-8133-fab665012e31 already deleted. [ 1078.109444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a5d12a9-8fd1-41d2-8133-fab665012e31" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.235974] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1078.236219] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.282023] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.282484] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.282703] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.283052] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.283250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.283455] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port a9a88587-478e-4d68-b921-c5eeb55e0a1e not found, creating... [ 1078.283867] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.284077] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.284286] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.284546] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.284706] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.285102] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.285314] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.285487] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.285752] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.285954] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.286154] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: a9a88587-478e-4d68-b921-c5eeb55e0a1e is going to be created. [ 1078.307533] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.307533] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.307533] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.307533] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.307533] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.307533] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.989688] env[69728]: INFO networking_nsxv3.common.synchronization [req-a4733fa3-5c6d-41da-b54e-b0c343c2ec3f req-94217df2-cc1c-48ab-9109-2539a0f27232 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_members [ 1078.989688] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGHEST for action security_group_members [ 1078.990647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.991057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.991300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.991718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.992107] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.992423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.992654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.993018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.995019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.995019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.466103] env[69728]: INFO networking_nsxv3.common.synchronization [req-93372df4-766e-46b1-b939-bd7855718bde req-d38eccc2-68de-4872-b5db-e95fb45a9b33 service nova] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_rules [ 1079.466918] env[69728]: INFO networking_nsxv3.common.synchronization [req-93372df4-766e-46b1-b939-bd7855718bde req-d38eccc2-68de-4872-b5db-e95fb45a9b33 service nova] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1079.466918] env[69728]: INFO networking_nsxv3.common.synchronization [req-93372df4-766e-46b1-b939-bd7855718bde req-d38eccc2-68de-4872-b5db-e95fb45a9b33 service nova] Enqueued Resource ID: a9a88587-478e-4d68-b921-c5eeb55e0a1e with Priority: HIGHEST for action port [ 1079.466918] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_rules [ 1079.466918] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1079.466918] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9a88587-478e-4d68-b921-c5eeb55e0a1e with Priority: HIGHEST for action port [ 1079.467514] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.468266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.468440] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.468533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.468715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9a88587-478e-4d68-b921-c5eeb55e0a1e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.468872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.468872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.469092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.469173] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9a88587-478e-4d68-b921-c5eeb55e0a1e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.497307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.497491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.497567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.498251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.498356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.498569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.498677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.498744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.499139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.499688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.499688] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 is going to be updated. [ 1079.528925] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.529121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.529213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.529470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.530187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.537931] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 in Status: IN_PROGRESS for 2s [ 1079.832706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1079.832934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.833117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.833337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.833522] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.833644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.835489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.835489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.835489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.835489] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.943140] env[69728]: INFO networking_nsxv3.common.synchronization [req-41e2abf7-7600-4226-8b32-9cf6f44f25fa req-846bc44d-3342-4583-87a9-e8e8dc308f85 tempest-ServerAddressesNegativeTestJSON-721746183 tempest-ServerAddressesNegativeTestJSON-721746183-project-member] Enqueued Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_members [ 1079.943140] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_members [ 1079.943140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.943140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.943140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.944640] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.945162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.945903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.945903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.945903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.945903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.945903] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.970884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9a88587-478e-4d68-b921-c5eeb55e0a1e with status ACTIVE [ 1079.971127] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.971260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.971299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.971471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.971601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.971726] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.971884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.971884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.972041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.972141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.972288] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.972411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.972439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.975257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.975257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.975257] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9a88587-478e-4d68-b921-c5eeb55e0a1e is going to be updated. [ 1079.998387] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.998387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.998387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.998387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.998387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.998387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9a88587-478e-4d68-b921-c5eeb55e0a1e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.340780] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.448579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.448579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.448579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.448579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.448579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.448787] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.448787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.448787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.448930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.449016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.449119] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc already deleted. [ 1080.449243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.451668] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.451920] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-94" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.452108] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-94" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.452458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-94" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.452791] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.453008] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.453178] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.453435] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.453632] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.453954] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.454133] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.454279] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.454420] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.454571] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1080.454736] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.454922] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.475751] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.475751] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1080.475751] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.475751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-94" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.475751] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-8d919564-efe3-45dd-a357-c63edc4b3a33 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.475751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.475751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.475751] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.475751] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d919564-efe3-45dd-a357-c63edc4b3a33',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.843435] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.977986] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.979143] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.979143] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.979143] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.979301] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.982787] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 8d919564-efe3-45dd-a357-c63edc4b3a33 not found, creating... [ 1080.982787] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.985350] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.985593] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.986010] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.986293] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.986794] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.987102] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.987339] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.987713] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.988314] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.989759] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 8d919564-efe3-45dd-a357-c63edc4b3a33 is going to be created. [ 1081.009232] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.010397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.010397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.010397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.010397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.010916] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.316472] env[69728]: INFO networking_nsxv3.common.synchronization [req-669544e9-0d0d-4b44-b6d8-c18d30a62410 req-87d8c50a-83ed-4d59-840a-f7a4638e1126 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_members [ 1081.316472] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGHEST for action security_group_members [ 1081.316472] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.316678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.316678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.316747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.316912] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.317510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.317603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.317806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.318121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.318121] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.348437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.348589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.348694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.348875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.348974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.349070] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be updated. [ 1081.377313] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.377499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.377499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.377748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.377841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.387017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1081.546977] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 in Status: SUCCESS [ 1081.547286] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 deletion is rescheduled due to dependency. [ 1081.547286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.820919] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.821254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.821336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.821555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.821729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.821963] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.822085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.822213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.822328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.822380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.822486] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 is going to be updated. [ 1081.850795] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.850929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.850997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.851273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.852339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.863021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 in Status: IN_PROGRESS for 2s [ 1082.496064] env[69728]: INFO networking_nsxv3.common.synchronization [req-41e2abf7-7600-4226-8b32-9cf6f44f25fa req-6947bc8f-0f43-4dcc-94a8-c3ed88422b91 service nova] Enqueued Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_rules [ 1082.496064] env[69728]: INFO networking_nsxv3.common.synchronization [req-41e2abf7-7600-4226-8b32-9cf6f44f25fa req-6947bc8f-0f43-4dcc-94a8-c3ed88422b91 service nova] Enqueued Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_members [ 1082.496064] env[69728]: INFO networking_nsxv3.common.synchronization [req-41e2abf7-7600-4226-8b32-9cf6f44f25fa req-6947bc8f-0f43-4dcc-94a8-c3ed88422b91 service nova] Enqueued Resource ID: 8d919564-efe3-45dd-a357-c63edc4b3a33 with Priority: HIGHEST for action port [ 1082.496643] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_rules [ 1082.497237] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_members [ 1082.497436] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d919564-efe3-45dd-a357-c63edc4b3a33 with Priority: HIGHEST for action port [ 1082.501128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.501128] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.501128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.501128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.501128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.501128] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.502754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d919564-efe3-45dd-a357-c63edc4b3a33 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.502980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.503203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.503447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.503696] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d919564-efe3-45dd-a357-c63edc4b3a33',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.005704] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.006731] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.006843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.006995] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d919564-efe3-45dd-a357-c63edc4b3a33 with status ACTIVE [ 1083.007164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.007271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.007328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.007550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.007603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.007771] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.007866] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.007926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.008086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.008163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.009378] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.009378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.009514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.010683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.010683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.010683] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d919564-efe3-45dd-a357-c63edc4b3a33 is going to be updated. [ 1083.028402] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.028541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.028612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.028806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.028939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.029100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d919564-efe3-45dd-a357-c63edc4b3a33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.399361] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.399361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.399361] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.399361] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.399361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.400789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.400997] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.516021] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.718090] env[69728]: INFO networking_nsxv3.common.synchronization [req-c9de2706-09e8-45a6-91da-a2622b91e2df req-a02c69ed-f3f2-4f87-8ce4-07608daf1269 tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1083.718090] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1083.718090] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.718090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.718090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.718463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.718463] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.718564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.718564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.718702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.718789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.718882] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.874481] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 in Status: SUCCESS [ 1083.874669] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 deletion is rescheduled due to dependency. [ 1083.874796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.904426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.904426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.904426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.014428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.014905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.014905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.014905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.015337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.015337] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc is going to be created. [ 1084.044174] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.044174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.044174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.044174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.044174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.052038] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc in Status: UNINITIALIZED for 2s [ 1084.223856] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.408402] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.727132] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.912604] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.912798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.912798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.912989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.913099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.913204] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be updated. [ 1084.943448] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.943448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.943448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.943448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.943448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.950973] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1085.231792] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.231792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.231792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.231792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.231792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.231792] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1085.259761] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.259982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.259982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.260155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.260305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.268790] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1086.064582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc in Status: SUCCESS [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.064582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.064582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.064582] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.566988] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.567372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.567372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.567586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.569880] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.569880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.570070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.570307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.572743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.572743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.572937] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.573075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.573205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.573366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.573474] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.573693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.573693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.573915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.573915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.573974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.574378] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.962319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1086.962600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.962823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.963102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.963321] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.963466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.963531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.963729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.963801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.963929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.964145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.964254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.964316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.964450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.964601] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.964696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.964746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.964881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.964983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.965058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.965138] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.077093] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc: rpc.has_security_group_logging(os_id): False [ 1087.095156] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.095372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.095372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.095751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.095751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.095913] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.095998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.096369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.096369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.096369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.096551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.096657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.096711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.096859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.096935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.097143] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.097240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.097297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.097439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.097515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.097615] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc is going to be created. [ 1087.148891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.148891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.148891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.148891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.148891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.160254] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc in Status: IN_PROGRESS for 2s [ 1087.280327] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1087.280455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.468577] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98ee287a-374d-44ae-b682-134db3270cba: rpc.has_security_group_logging(os_id): False [ 1087.486076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.486206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.486206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.486386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.486477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.486662] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.486759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.486823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.486967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.487061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.487265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.487371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.487537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.487689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.487767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.487952] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.488188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.488428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.488428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.488529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.488529] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be created. [ 1087.541171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.541422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.541533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.541859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.542164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.554030] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1088.720824] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1088.720824] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1089.172510] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc in Status: SUCCESS [ 1089.172839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.721454] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1089.721831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.721831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.722012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.722109] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.224309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.225436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.225533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.225786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.226053] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.226053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.226159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.226255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.226339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.226424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.226509] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.332030] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7951225f-c945-4b9b-af70-b76bedee6a35 None None] Enqueued Resource ID: 6dc56968-15ea-4c58-b87c-fd2a45a367b1 with Priority: HIGHEST for action port [ 1090.334136] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dc56968-15ea-4c58-b87c-fd2a45a367b1 with Priority: HIGHEST for action port [ 1090.334136] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dc56968-15ea-4c58-b87c-fd2a45a367b1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.334136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dc56968-15ea-4c58-b87c-fd2a45a367b1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.338025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dc56968-15ea-4c58-b87c-fd2a45a367b1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.338025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dc56968-15ea-4c58-b87c-fd2a45a367b1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.338025] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dc56968-15ea-4c58-b87c-fd2a45a367b1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.735201] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.735201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.735201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.735501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.735738] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.736879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.736879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.736879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.736879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.736879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.736879] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.736879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.737456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.737672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.737897] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.739777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.739777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.739777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.739777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.739777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.739777] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.837908] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dc56968-15ea-4c58-b87c-fd2a45a367b1 [ 1090.838459] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.838459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.838459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.838639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.838743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.838879] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dc56968-15ea-4c58-b87c-fd2a45a367b1 already deleted. [ 1090.839066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dc56968-15ea-4c58-b87c-fd2a45a367b1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.242628] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98ee287a-374d-44ae-b682-134db3270cba: rpc.has_security_group_logging(os_id): False [ 1091.263636] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.263798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.263871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.264193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.264262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.264451] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.264568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.264630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.264780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.264856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.265096] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.265197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.265240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.265387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.265450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.265774] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.265774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.265774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.266067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.266067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.266270] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be updated. [ 1091.326608] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.327246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.327246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.327246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.327246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.346765] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1092.502987] env[69728]: INFO networking_nsxv3.common.synchronization [req-7f41859a-1be5-4309-bb82-f3f75f6ec92f req-7a2fa0c9-be44-426c-a562-39cbbdfce1d2 tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1092.503404] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1092.505162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.505162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.505162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.505162] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.009613] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.106067] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3d0a9fd1-48fc-4f49-a6e5-81a61978cad8 None None] Enqueued Resource ID: d83014f1-b908-4679-9924-d094dd7cddb5 with Priority: HIGHEST for action port [ 1093.106656] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d83014f1-b908-4679-9924-d094dd7cddb5 with Priority: HIGHEST for action port [ 1093.110027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-d83014f1-b908-4679-9924-d094dd7cddb5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.110027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d83014f1-b908-4679-9924-d094dd7cddb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.110027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d83014f1-b908-4679-9924-d094dd7cddb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.110027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d83014f1-b908-4679-9924-d094dd7cddb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.110027] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d83014f1-b908-4679-9924-d094dd7cddb5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.363400] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1093.363631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.513485] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.609692] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d83014f1-b908-4679-9924-d094dd7cddb5 [ 1093.610951] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.610951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.610951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.610951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.610951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.610951] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d83014f1-b908-4679-9924-d094dd7cddb5 already deleted. [ 1093.610951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d83014f1-b908-4679-9924-d094dd7cddb5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.021647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.022030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.022030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.022180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.022661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.022661] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1094.048055] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.048203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.048269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.050145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.050145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.058191] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1095.252655] env[69728]: INFO networking_nsxv3.common.synchronization [None req-fe8e734b-c091-403e-b6e4-45dfca19ed18 None None] Enqueued Resource ID: 004e0b26-baa9-4d16-bc5f-0206cce2dac5 with Priority: HIGHEST for action port [ 1095.254017] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004e0b26-baa9-4d16-bc5f-0206cce2dac5 with Priority: HIGHEST for action port [ 1095.254017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-004e0b26-baa9-4d16-bc5f-0206cce2dac5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.254017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-004e0b26-baa9-4d16-bc5f-0206cce2dac5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.254017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-004e0b26-baa9-4d16-bc5f-0206cce2dac5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.257353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-004e0b26-baa9-4d16-bc5f-0206cce2dac5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.257459] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004e0b26-baa9-4d16-bc5f-0206cce2dac5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.317234] env[69728]: INFO networking_nsxv3.common.synchronization [req-1d17e651-ebdf-489a-a477-82b21da3a775 req-e7a82bda-6916-4204-bd9b-455712de829a tempest-ServerAddressesNegativeTestJSON-721746183 tempest-ServerAddressesNegativeTestJSON-721746183-project-member] Enqueued Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_members [ 1095.317646] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc with Priority: HIGHEST for action security_group_members [ 1095.318193] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.318828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.318828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.318828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.318828] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.318828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.319720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.319720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.319720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.319720] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1af596d4-70db-49cb-b5dd-9bb7c04a2bdc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.761083] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 004e0b26-baa9-4d16-bc5f-0206cce2dac5 [ 1095.761519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.761519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.761519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.762934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.762934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.762934] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:004e0b26-baa9-4d16-bc5f-0206cce2dac5 already deleted. [ 1095.762934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-004e0b26-baa9-4d16-bc5f-0206cce2dac5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.821335] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.821436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.821516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.821975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.822104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.822324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.822423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.822481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.822692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.822872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.822872] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc is going to be updated. [ 1095.858781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.858937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.858998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.859264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.859410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.868524] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc in Status: IN_PROGRESS for 2s [ 1096.073777] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1096.074534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.664422] env[69728]: INFO networking_nsxv3.common.synchronization [req-a3ca05cb-b945-4af2-b1f0-a4c3ee4522fd req-788cae9b-e463-4b9c-a5c1-78baef919257 tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_members [ 1096.665179] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc1b947-36b1-4b46-9434-017900494d57 with Priority: HIGHEST for action security_group_members [ 1096.665647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-2cc1b947-36b1-4b46-9434-017900494d57 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.665781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.665848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.666125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.666285] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.666408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.666473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.666625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.666706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.666797] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2cc1b947-36b1-4b46-9434-017900494d57',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.096625] env[69728]: INFO networking_nsxv3.common.synchronization [None req-56fd85ba-6208-4512-98a6-1cf88a2c957e tempest-ServersTestJSON-923810699 tempest-ServersTestJSON-923810699-project-member] Enqueued Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_rules [ 1097.097165] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_rules [ 1097.097477] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.097598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.097665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.099395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.099506] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.169356] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.169477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.169477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.169691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.169790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.169998] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.170111] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.170204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.170399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.170479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.170569] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 is going to be updated. [ 1097.199009] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.199202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.199278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.199493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.200564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.215624] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cc1b947-36b1-4b46-9434-017900494d57 in Status: IN_PROGRESS for 2s [ 1097.234183] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3a8f4421-c849-49c9-b69f-7bc8611b58b3 tempest-ServersTestJSON-923810699 tempest-ServersTestJSON-923810699-project-member] Enqueued Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_rules [ 1097.234183] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_rules [ 1097.234183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.236254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.299293] env[69728]: INFO networking_nsxv3.common.synchronization [None req-3fbb2f62-2e08-4c2a-86d7-272c1a37a17f None None] Enqueued Resource ID: a127d9b0-a5d7-4855-8d3d-50d916452691 with Priority: HIGHEST for action port [ 1097.302193] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a127d9b0-a5d7-4855-8d3d-50d916452691 with Priority: HIGHEST for action port [ 1097.303327] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a127d9b0-a5d7-4855-8d3d-50d916452691 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.303460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a127d9b0-a5d7-4855-8d3d-50d916452691" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.303527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a127d9b0-a5d7-4855-8d3d-50d916452691" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.306736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a127d9b0-a5d7-4855-8d3d-50d916452691" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.306836] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a127d9b0-a5d7-4855-8d3d-50d916452691',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.621964] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.622219] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.622297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.622532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.622624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.622760] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d already deleted. [ 1097.622847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.622999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.623168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.623253] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.808722] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a127d9b0-a5d7-4855-8d3d-50d916452691 [ 1097.808962] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.809064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.809133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.809346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.809667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.809803] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a127d9b0-a5d7-4855-8d3d-50d916452691 already deleted. [ 1097.809893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a127d9b0-a5d7-4855-8d3d-50d916452691" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.881293] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc in Status: SUCCESS [ 1097.881293] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1af596d4-70db-49cb-b5dd-9bb7c04a2bdc deletion is rescheduled due to dependency. [ 1097.881293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1af596d4-70db-49cb-b5dd-9bb7c04a2bdc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.143891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.144066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.144156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.144374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.144460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.144558] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d already deleted. [ 1098.144627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.314602] env[69728]: INFO networking_nsxv3.common.synchronization [req-0a0ae399-cc14-4c92-acc9-e87974136919 req-f0ef0a83-d818-4f86-8215-9217d90af72f tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1098.315200] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1098.315529] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.315653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.315726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.316597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.316994] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.316994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.316994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.317215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.317244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.317329] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.823455] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.824339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.824339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.824339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.824339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.824567] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.824618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.824649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.825241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.825241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.825241] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 already deleted. [ 1098.825241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.004625] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.004818] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.004942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.005237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.005506] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.005738] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.005777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.005994] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.006157] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.006406] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.006507] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.006672] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.007110] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.007110] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1099.007110] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.007378] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.028640] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.028640] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1099.028640] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.028640] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.028640] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-bf5332fc-a210-45be-b50e-f5076a32bea0 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.028640] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.028640] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.028640] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.029110] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5332fc-a210-45be-b50e-f5076a32bea0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.227700] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2cc1b947-36b1-4b46-9434-017900494d57 in Status: SUCCESS [ 1099.227700] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2cc1b947-36b1-4b46-9434-017900494d57 deletion is rescheduled due to dependency. [ 1099.227836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2cc1b947-36b1-4b46-9434-017900494d57" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.532543] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.532827] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.532970] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.533304] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.533837] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.533837] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port bf5332fc-a210-45be-b50e-f5076a32bea0 not found, creating... [ 1099.533957] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.534132] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.534313] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.534603] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.534870] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.535137] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.535283] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.535393] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.535609] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.535767] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.535896] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: bf5332fc-a210-45be-b50e-f5076a32bea0 is going to be created. [ 1099.556413] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.556915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.556915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.557043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.557294] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.557553] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.262141] env[69728]: INFO networking_nsxv3.common.synchronization [None req-2dfdca3e-40dd-461f-9411-e9e3be3d758e None None] Enqueued Resource ID: 1a70b208-33e9-4ee1-8e5e-289319140ca1 with Priority: HIGHEST for action port [ 1100.264110] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a70b208-33e9-4ee1-8e5e-289319140ca1 with Priority: HIGHEST for action port [ 1100.264110] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a70b208-33e9-4ee1-8e5e-289319140ca1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.264110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a70b208-33e9-4ee1-8e5e-289319140ca1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.264110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a70b208-33e9-4ee1-8e5e-289319140ca1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.264110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a70b208-33e9-4ee1-8e5e-289319140ca1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.264110] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a70b208-33e9-4ee1-8e5e-289319140ca1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.511441] env[69728]: INFO networking_nsxv3.common.synchronization [None req-2910b955-a489-47a0-92aa-59d68cd80dc5 None None] Enqueued Resource ID: ffab17af-ff43-432a-ba0e-19e82ed47b37 with Priority: HIGHEST for action port [ 1100.511712] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffab17af-ff43-432a-ba0e-19e82ed47b37 with Priority: HIGHEST for action port [ 1100.512341] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffab17af-ff43-432a-ba0e-19e82ed47b37 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.512463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffab17af-ff43-432a-ba0e-19e82ed47b37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.512535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffab17af-ff43-432a-ba0e-19e82ed47b37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.512790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffab17af-ff43-432a-ba0e-19e82ed47b37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.512888] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffab17af-ff43-432a-ba0e-19e82ed47b37',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.741574] env[69728]: INFO networking_nsxv3.common.synchronization [req-0a0ae399-cc14-4c92-acc9-e87974136919 req-2fb8401d-88f7-471b-be4e-711de5511db0 service nova] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1100.741767] env[69728]: INFO networking_nsxv3.common.synchronization [req-0a0ae399-cc14-4c92-acc9-e87974136919 req-2fb8401d-88f7-471b-be4e-711de5511db0 service nova] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1100.741910] env[69728]: INFO networking_nsxv3.common.synchronization [req-0a0ae399-cc14-4c92-acc9-e87974136919 req-2fb8401d-88f7-471b-be4e-711de5511db0 service nova] Enqueued Resource ID: bf5332fc-a210-45be-b50e-f5076a32bea0 with Priority: HIGHEST for action port [ 1100.742215] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1100.742349] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1100.742445] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf5332fc-a210-45be-b50e-f5076a32bea0 with Priority: HIGHEST for action port [ 1100.746011] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.746556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.746983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.746983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.747170] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.750567] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.750690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.750758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.750944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.751112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.751290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.751290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.751407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.751494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.752197] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.752759] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf5332fc-a210-45be-b50e-f5076a32bea0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.752862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.752862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.753133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.753211] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf5332fc-a210-45be-b50e-f5076a32bea0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.766653] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a70b208-33e9-4ee1-8e5e-289319140ca1 [ 1100.766783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.768951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.768951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.768951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.768951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.768951] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a70b208-33e9-4ee1-8e5e-289319140ca1 already deleted. [ 1100.768951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a70b208-33e9-4ee1-8e5e-289319140ca1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.016874] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffab17af-ff43-432a-ba0e-19e82ed47b37 [ 1101.016874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.016874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.016874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.016874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.016874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.016874] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffab17af-ff43-432a-ba0e-19e82ed47b37 already deleted. [ 1101.016874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffab17af-ff43-432a-ba0e-19e82ed47b37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.257338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.257461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.261718] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.261718] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf5332fc-a210-45be-b50e-f5076a32bea0 with status ACTIVE [ 1101.261718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.261718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.261718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.261718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.262414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.262414] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf5332fc-a210-45be-b50e-f5076a32bea0 is going to be updated. [ 1101.284450] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.284583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.284650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.284856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.284989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.285223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf5332fc-a210-45be-b50e-f5076a32bea0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.674208] env[69728]: INFO networking_nsxv3.common.synchronization [req-6465f009-6a0b-4446-aef3-dbe1f85edec6 req-a93a47ab-b452-41af-94c6-c95e21006fb2 tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: 7315218a-99c3-43cf-84b0-07883e838847 with Priority: HIGHEST for action security_group_rules [ 1101.674736] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7315218a-99c3-43cf-84b0-07883e838847 with Priority: HIGHEST for action security_group_rules [ 1101.675047] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7315218a-99c3-43cf-84b0-07883e838847 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.675207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7315218a-99c3-43cf-84b0-07883e838847" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.675280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7315218a-99c3-43cf-84b0-07883e838847" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.675524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7315218a-99c3-43cf-84b0-07883e838847" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.675605] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7315218a-99c3-43cf-84b0-07883e838847',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.763586] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.221236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.221236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.221401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.221505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.221595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.221700] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7315218a-99c3-43cf-84b0-07883e838847 already deleted. [ 1102.221780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7315218a-99c3-43cf-84b0-07883e838847" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.269611] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.269911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.269911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.270067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.270271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.270271] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be created. [ 1102.292338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.292490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.292564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.292776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.293045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.302242] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: UNINITIALIZED for 2s [ 1102.390469] env[69728]: INFO networking_nsxv3.common.synchronization [req-ae1eee74-8863-4952-8068-d59daf973803 req-3b2ed36a-be08-4c01-806f-26a0aa7f3b9a tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: 2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a with Priority: HIGHEST for action security_group_rules [ 1102.391113] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a with Priority: HIGHEST for action security_group_rules [ 1102.391489] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.391610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.391823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.391947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.393604] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.687925] env[69728]: INFO networking_nsxv3.common.synchronization [None req-6e4f2cb2-2ed2-4636-a1e2-7c66c7ea6406 None None] Enqueued Resource ID: ecd5281e-8141-478f-bc5d-310524e618ed with Priority: HIGHEST for action port [ 1102.688895] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecd5281e-8141-478f-bc5d-310524e618ed with Priority: HIGHEST for action port [ 1102.688895] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecd5281e-8141-478f-bc5d-310524e618ed taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.688895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecd5281e-8141-478f-bc5d-310524e618ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.689101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecd5281e-8141-478f-bc5d-310524e618ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.689301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecd5281e-8141-478f-bc5d-310524e618ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.689301] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecd5281e-8141-478f-bc5d-310524e618ed',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.889449] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5a6923a1-00a5-4f0a-a987-7c24593b4084 None None] Enqueued Resource ID: cc14848f-3bcb-45c1-89ad-9d50d1cc177e with Priority: HIGHEST for action port [ 1102.889449] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc14848f-3bcb-45c1-89ad-9d50d1cc177e with Priority: HIGHEST for action port [ 1102.889909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc14848f-3bcb-45c1-89ad-9d50d1cc177e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.890081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc14848f-3bcb-45c1-89ad-9d50d1cc177e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.890226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc14848f-3bcb-45c1-89ad-9d50d1cc177e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.890856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc14848f-3bcb-45c1-89ad-9d50d1cc177e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.891073] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc14848f-3bcb-45c1-89ad-9d50d1cc177e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.912376] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.912521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.912594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.912809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.912895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.912990] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a already deleted. [ 1102.913149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a20fc2d-3885-422d-bd18-6ffc2a3a7b8a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.192803] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecd5281e-8141-478f-bc5d-310524e618ed [ 1103.192803] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.192803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.192803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.192803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.192803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.192803] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecd5281e-8141-478f-bc5d-310524e618ed already deleted. [ 1103.192803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecd5281e-8141-478f-bc5d-310524e618ed" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.395025] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc14848f-3bcb-45c1-89ad-9d50d1cc177e [ 1103.395025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.395025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.395025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.395025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.395025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.396902] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc14848f-3bcb-45c1-89ad-9d50d1cc177e already deleted. [ 1103.396902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc14848f-3bcb-45c1-89ad-9d50d1cc177e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.090534] env[69728]: INFO networking_nsxv3.common.synchronization [req-8a972577-18e4-42a4-b6f0-57a3d29914ed req-3ea23d85-22b8-4762-9fe0-30f319698dd9 tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: d4b477ab-64cb-4674-ac32-89067caddd89 with Priority: HIGHEST for action security_group_rules [ 1104.094024] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4b477ab-64cb-4674-ac32-89067caddd89 with Priority: HIGHEST for action security_group_rules [ 1104.094024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4b477ab-64cb-4674-ac32-89067caddd89 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.094024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4b477ab-64cb-4674-ac32-89067caddd89" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.094024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4b477ab-64cb-4674-ac32-89067caddd89" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.094024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4b477ab-64cb-4674-ac32-89067caddd89" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.094024] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4b477ab-64cb-4674-ac32-89067caddd89',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.269614] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1104.269754] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1104.317703] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.317703] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.317703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.318028] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.612964] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.612964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.613292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.613292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.613377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.613416] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4b477ab-64cb-4674-ac32-89067caddd89 already deleted. [ 1104.613616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4b477ab-64cb-4674-ac32-89067caddd89" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.811128] env[69728]: INFO networking_nsxv3.common.synchronization [req-cdeb459d-f1b0-4082-a112-ffab5196f754 req-8d114339-6fcc-41a6-ad42-73864e54e740 tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: 1a936972-7174-41a6-9e0f-4144ae55e85e with Priority: HIGHEST for action security_group_rules [ 1104.811653] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a936972-7174-41a6-9e0f-4144ae55e85e with Priority: HIGHEST for action security_group_rules [ 1104.811989] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a936972-7174-41a6-9e0f-4144ae55e85e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.812123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a936972-7174-41a6-9e0f-4144ae55e85e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.812189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a936972-7174-41a6-9e0f-4144ae55e85e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.812435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a936972-7174-41a6-9e0f-4144ae55e85e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.812518] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a936972-7174-41a6-9e0f-4144ae55e85e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.820481] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.322677] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8408d52-084d-4902-9059-c9e45aefc511: rpc.has_security_group_logging(os_id): False [ 1105.336032] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.336032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.336032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.336032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.336032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.336032] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a936972-7174-41a6-9e0f-4144ae55e85e already deleted. [ 1105.336032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a936972-7174-41a6-9e0f-4144ae55e85e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.338658] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.338658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.338809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.338921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.339016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.339289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.339405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.339459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.339627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.339697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.339790] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be created. [ 1105.393676] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.393902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.393902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.395327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.395327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.400291] env[69728]: INFO networking_nsxv3.common.synchronization [req-7f004838-5055-4ec4-96b3-d21c5d33f66f req-516bc0ad-3bd1-4ac0-b72a-d6cdd0cfaea7 tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 with Priority: HIGHEST for action security_group_rules [ 1105.400988] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 with Priority: HIGHEST for action security_group_rules [ 1105.401184] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2df66c63-452b-4e26-8833-5aac93cf2e33 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.401356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.401426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.401623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.401710] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2df66c63-452b-4e26-8833-5aac93cf2e33',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.404514] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1105.633832] env[69728]: INFO networking_nsxv3.common.synchronization [req-bc50e9f4-33de-4237-a4ae-f7b54becf782 req-e1d7cefe-26df-4e2c-91ff-0b6f90e8ee6d tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 with Priority: HIGHEST for action security_group_rules [ 1105.634452] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 with Priority: HIGHEST for action security_group_rules [ 1105.634759] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2df66c63-452b-4e26-8833-5aac93cf2e33 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.634861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.917823] env[69728]: INFO networking_nsxv3.common.synchronization [req-421ac4e1-5c1e-4343-9b93-8e4f6fa4a036 req-c0eb93ed-fccb-4c3d-b1c1-8ee57d792f37 tempest-SecurityGroupRulesTestJSON-1844740725 tempest-SecurityGroupRulesTestJSON-1844740725-project-member] Enqueued Resource ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 with Priority: HIGHEST for action security_group_rules [ 1105.919284] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 with Priority: HIGHEST for action security_group_rules [ 1105.921258] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2df66c63-452b-4e26-8833-5aac93cf2e33 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.921783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.928190] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.929954] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 already deleted. [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.929954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.929954] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2df66c63-452b-4e26-8833-5aac93cf2e33',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.450915] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.450915] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 already deleted. [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.450915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.450915] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2df66c63-452b-4e26-8833-5aac93cf2e33',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.971417] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.971681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.971681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.971924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.971924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.972098] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2df66c63-452b-4e26-8833-5aac93cf2e33 already deleted. [ 1106.972198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2df66c63-452b-4e26-8833-5aac93cf2e33" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.417163] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1107.417515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.558544] env[69728]: INFO networking_nsxv3.common.synchronization [req-8934147f-3bac-467d-9fc8-117a6dff109c req-5abc370f-3eb4-469b-9a0e-484cc8ea90b5 tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1109.559165] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1109.559476] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.559595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.563145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.563390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.563566] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.563664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.564056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.564056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.565154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.565309] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.067755] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.067755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.067755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.068625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.068625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.068625] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.068625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.068625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.068625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.068625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.068625] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1110.098603] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.098912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.099104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.099473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.101199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.108462] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1112.115822] env[69728]: INFO networking_nsxv3.common.synchronization [req-0ebafc95-1f58-406a-b6d2-fa56209f0baf req-0add5af8-12f8-450b-bf15-7afcc80ed8dd tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_members [ 1112.116161] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 with Priority: HIGHEST for action security_group_members [ 1112.118559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.118559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.118559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.118559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.118559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.118899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.118899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.118899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.118995] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.119038] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.129029] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1112.129029] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 1112.129242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.248920] env[69728]: INFO networking_nsxv3.common.synchronization [None req-fbfa30e1-46f3-412a-b89e-0a255e553227 None None] Enqueued Resource ID: 9222aaa0-724e-445a-9b29-36da2f3cbbcc with Priority: HIGHEST for action port [ 1112.248920] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9222aaa0-724e-445a-9b29-36da2f3cbbcc with Priority: HIGHEST for action port [ 1112.252975] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9222aaa0-724e-445a-9b29-36da2f3cbbcc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.252975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9222aaa0-724e-445a-9b29-36da2f3cbbcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.252975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9222aaa0-724e-445a-9b29-36da2f3cbbcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.252975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9222aaa0-724e-445a-9b29-36da2f3cbbcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.252975] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9222aaa0-724e-445a-9b29-36da2f3cbbcc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.622973] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.622973] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.622973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.622973] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 is going to be updated. [ 1112.647608] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.647744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.647744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.648139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.648139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.657261] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 in Status: IN_PROGRESS for 2s [ 1112.755135] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9222aaa0-724e-445a-9b29-36da2f3cbbcc [ 1112.755396] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.755541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.756016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.756016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.756016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.756016] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9222aaa0-724e-445a-9b29-36da2f3cbbcc already deleted. [ 1112.756509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9222aaa0-724e-445a-9b29-36da2f3cbbcc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.408747] env[69728]: INFO networking_nsxv3.common.synchronization [None req-d59cd4de-129f-4fcf-bd6a-51347a8dc806 None None] Enqueued Resource ID: c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3 with Priority: HIGHEST for action port [ 1114.408747] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3 with Priority: HIGHEST for action port [ 1114.408747] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.408747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.408747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.409884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.410150] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.667821] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 in Status: SUCCESS [ 1114.668063] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4 deletion is rescheduled due to dependency. [ 1114.668216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.913229] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3 [ 1114.913622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.913622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.913865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.913865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.913952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.914064] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3 already deleted. [ 1114.914212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c73c7f5e-fac2-4c6f-b539-5a0044ee6fe3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.448423] env[69728]: INFO networking_nsxv3.common.synchronization [req-e169b381-f88e-44f0-97d7-cd5c3d7c1186 req-d3b31ba5-de5f-4588-874b-fe005824fcbf tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1115.448423] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1115.448423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.454838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.454838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.454838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.455280] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.456458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.457262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.457469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.459664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.459664] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.904846] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.905078] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.905227] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.905634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.905904] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.906092] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.906214] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.906441] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.906590] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.906914] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.906914] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.907064] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.907155] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.907269] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1115.907380] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.907517] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.945044] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.945044] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1115.945044] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.945044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.945044] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.945554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.945554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.945554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.945669] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.962282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.962413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.962482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.962690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.962776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.962963] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.963070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.963133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.963311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.963397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.963481] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb already deleted. [ 1115.963557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.165177] env[69728]: INFO networking_nsxv3.common.synchronization [req-1a78b625-8925-498f-a890-820b5dd493c0 req-463c4c8e-d66f-4952-8a7e-bd3f84392a06 tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1116.165726] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1116.166267] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.166409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.166483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.166670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.166827] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.166916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.166977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.167150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.167238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.167329] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.447855] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.448113] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.448254] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.449018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.449018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.449018] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 not found, creating... [ 1116.449620] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.449620] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.449906] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.449906] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.450100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.450442] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.451360] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.451360] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.451360] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.451360] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.451360] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 is going to be created. [ 1116.469826] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.470050] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.470182] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.470587] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.470666] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.471300] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.669096] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.172486] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.310805] env[69728]: INFO networking_nsxv3.common.synchronization [req-e169b381-f88e-44f0-97d7-cd5c3d7c1186 req-c52ff58a-0e21-45c1-b31d-c6eb06b9e9cf service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1117.311111] env[69728]: INFO networking_nsxv3.common.synchronization [req-e169b381-f88e-44f0-97d7-cd5c3d7c1186 req-c52ff58a-0e21-45c1-b31d-c6eb06b9e9cf service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1117.312145] env[69728]: INFO networking_nsxv3.common.synchronization [req-e169b381-f88e-44f0-97d7-cd5c3d7c1186 req-c52ff58a-0e21-45c1-b31d-c6eb06b9e9cf service nova] Enqueued Resource ID: 4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 with Priority: HIGHEST for action port [ 1117.314718] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1117.315226] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1117.315419] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 with Priority: HIGHEST for action port [ 1117.315743] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.315871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.315938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.316214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.316310] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.317630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.317630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.317630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.317630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.318195] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.318195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.318195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.318195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.318195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.318195] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.318847] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.318968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.319037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.319247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.319333] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.673938] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.674351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.674351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.674443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.674531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.674636] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1117.701617] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.701800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.701865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.702158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.702337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.710169] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1117.820923] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.821146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.821803] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.822689] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 with status ACTIVE [ 1117.822689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.822689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.822870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.823331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.823331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.823331] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.823522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.823522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.823678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.823765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.823987] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.824151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.824230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.824393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.824581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.824663] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5 is going to be updated. [ 1117.846051] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.846203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.846280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.846475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.846608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.846770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e0ebd5f-ecc0-4e1c-a2ad-2f6c0fcfabc5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.969596] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5ff989ba-7b9d-4ff4-80d0-504adf620058 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_rules [ 1117.970174] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_rules [ 1117.970494] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.970673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.970673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.972442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.972442] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.042392] env[69728]: INFO networking_nsxv3.common.synchronization [None req-8e8d68a3-e403-4041-bace-75c7cca82fc9 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_rules [ 1118.043176] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_rules [ 1118.043176] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.043317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.327345] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.332557] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.332719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.332815] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.333085] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.333345] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.333505] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.333623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.333835] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.333986] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.334267] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1118.334384] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.334585] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.334655] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.334726] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1118.334816] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.334947] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.351921] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.352092] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1118.352228] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.352412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-151" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.352738] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-ad4ed4ce-4479-4261-9a85-d42c2d139180 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.352874] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.353008] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.353268] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.353411] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4ed4ce-4479-4261-9a85-d42c2d139180',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.492801] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.493038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.493038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.493244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.493335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.493427] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f already deleted. [ 1118.493510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.493661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.493879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.493879] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.829367] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.829705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.829705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.829830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.829919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.830042] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be created. [ 1118.851074] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.851232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.851302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.851710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.851905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.858648] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.858648] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.858648] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.859250] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.859250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.859250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.859250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.859250] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.859637] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 is going to be updated. [ 1118.861553] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: UNINITIALIZED for 2s [ 1118.880514] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.881306] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.881593] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.881974] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.882205] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.882574] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.017732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.017881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.017950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.018708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.018708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.018708] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f already deleted. [ 1119.018708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.719917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1119.720254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.779371] env[69728]: INFO networking_nsxv3.common.synchronization [req-c21b4250-352f-4914-a6ec-4cc523926de8 req-70b823c4-486e-42b4-8375-34ce71a7f39e service nova] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_rules [ 1119.779371] env[69728]: INFO networking_nsxv3.common.synchronization [req-c21b4250-352f-4914-a6ec-4cc523926de8 req-70b823c4-486e-42b4-8375-34ce71a7f39e service nova] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 1119.779511] env[69728]: INFO networking_nsxv3.common.synchronization [req-c21b4250-352f-4914-a6ec-4cc523926de8 req-70b823c4-486e-42b4-8375-34ce71a7f39e service nova] Enqueued Resource ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 with Priority: HIGHEST for action port [ 1119.780108] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_rules [ 1119.780108] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 1119.780108] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 with Priority: HIGHEST for action port [ 1119.780567] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.780693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.780762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.780977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.781113] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.781901] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.782034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.782115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.782286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.782460] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.782603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.782691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.782890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.783010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.783124] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.783942] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad4ed4ce-4479-4261-9a85-d42c2d139180 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.783942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.784045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.784561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.784633] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4ed4ce-4479-4261-9a85-d42c2d139180',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.286402] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.286732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.286732] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.287626] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad4ed4ce-4479-4261-9a85-d42c2d139180 with status ACTIVE [ 1120.287842] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.288016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.288124] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.288357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.288473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.288674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.288803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.288896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.289041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.289135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.289418] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.290260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.290260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.290260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.290260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.290260] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad4ed4ce-4479-4261-9a85-d42c2d139180 is going to be updated. [ 1120.309243] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.309426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.309426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.309606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.309739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.309891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad4ed4ce-4479-4261-9a85-d42c2d139180" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.791780] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.871038] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1120.871180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.871325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.871540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.871746] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.871868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.871934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.872184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.872269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.872354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.872445] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.294385] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.294385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.294385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.294819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.294819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.294819] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 1121.319189] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.319376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.319443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.319758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.319874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.328496] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 1121.374055] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.374349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.374349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.374525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.374695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.374839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.374884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.375200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.375200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.375200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.375430] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.375430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.375591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.375628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.375744] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.375862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.375902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.376033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.376123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.376191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.376283] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.878961] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb: rpc.has_security_group_logging(os_id): False [ 1121.895587] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.895759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.895827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.896010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.896108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.896324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.896429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.896506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.896686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.896795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.896948] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.897058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.897121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.897259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.897331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.897527] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.897635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.897669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.897800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.897877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.897947] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be created. [ 1121.959786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.959786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.959786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.960080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.960137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.970648] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1123.339985] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 1123.340239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.340422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.340644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.341065] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.341240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.341240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.341412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.341494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.341582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.341676] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.843752] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.843838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.843942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.844196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.844407] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.844538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.844604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.844762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.844844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.844931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.845139] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.845215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.845260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.845476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.845684] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.845783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.846747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.846747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.846747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.846747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.846747] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.981584] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1123.981875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.349320] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15661f32-f427-4619-97c6-f59aec12ec77: rpc.has_security_group_logging(os_id): False [ 1124.367025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.367025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.367025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.368169] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.368453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.368665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.368969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.369217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.369597] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.369884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.370089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.372020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.372020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.372020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 1124.439250] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.439250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.439250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.439532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.439532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.454918] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 1124.781232] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1124.781232] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1126.470372] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 1126.470702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.782094] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1129.782416] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1129.872134] env[69728]: INFO networking_nsxv3.common.synchronization [req-161e85a7-481e-4142-aac9-d10efd2b2b2d req-68b2ee71-050c-4f41-b1a1-e224ee299217 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1129.873375] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1129.876386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.876386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.876386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.876386] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.377615] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.377872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.377872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.378031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.378194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.378324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.378457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.378528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.378634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.378706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.378794] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1130.407309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.407688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.407688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.407783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.408069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.420749] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1131.436202] env[69728]: INFO networking_nsxv3.common.synchronization [req-73eea8a3-05c2-4263-a5b8-de6a13b31600 req-f05340f4-9384-4049-a0af-00464d07170d tempest-ServersTestJSON-923810699 tempest-ServersTestJSON-923810699-project-member] Enqueued Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_members [ 1131.436846] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_members [ 1131.437237] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.437326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.437616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.437962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.438381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.438680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438939] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.942605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.942605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.942605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.942605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.942605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.942605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.942897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.942897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.942897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.943011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.943011] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d already deleted. [ 1131.943089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.149497] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-415 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.149497] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-415" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.149686] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-415" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.149953] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-415" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.150231] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.150488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.150558] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.150743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.150894] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.151308] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.151467] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.151660] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.151846] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.152050] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1132.152342] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.152587] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.180996] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.181210] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1132.181358] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.181543] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-415" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.181875] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-69ee1c02-d574-466d-abbe-5676b1530fb7 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.182144] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.182212] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.182530] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.182677] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ee1c02-d574-466d-abbe-5676b1530fb7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.427466] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1132.427587] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1132.427662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.685450] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.685802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.685802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.686083] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.686241] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.686410] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 69ee1c02-d574-466d-abbe-5676b1530fb7 not found, creating... [ 1132.686760] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.686930] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.687064] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.687299] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.687450] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.687746] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.687898] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.688043] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.688268] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.688411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.688554] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 69ee1c02-d574-466d-abbe-5676b1530fb7 is going to be created. [ 1132.707325] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.707542] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.707655] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.707896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.708151] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.708395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.602235] env[69728]: INFO networking_nsxv3.common.synchronization [req-73eea8a3-05c2-4263-a5b8-de6a13b31600 req-3ce1de62-f59a-4617-8ff2-647e2e314852 service nova] Enqueued Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_rules [ 1133.602235] env[69728]: INFO networking_nsxv3.common.synchronization [req-73eea8a3-05c2-4263-a5b8-de6a13b31600 req-3ce1de62-f59a-4617-8ff2-647e2e314852 service nova] Enqueued Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_members [ 1133.602235] env[69728]: INFO networking_nsxv3.common.synchronization [req-73eea8a3-05c2-4263-a5b8-de6a13b31600 req-3ce1de62-f59a-4617-8ff2-647e2e314852 service nova] Enqueued Resource ID: 69ee1c02-d574-466d-abbe-5676b1530fb7 with Priority: HIGHEST for action port [ 1133.602235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_rules [ 1133.602235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_members [ 1133.602235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ee1c02-d574-466d-abbe-5676b1530fb7 with Priority: HIGHEST for action port [ 1133.602576] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.602740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.602784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.603580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.603580] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.603854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.603950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.604023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.604226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.604413] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.604527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.604594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.604758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.604829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.604911] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.605640] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-69ee1c02-d574-466d-abbe-5676b1530fb7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.605779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.605841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.605991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.606525] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ee1c02-d574-466d-abbe-5676b1530fb7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.849829] env[69728]: INFO networking_nsxv3.common.synchronization [req-21e65506-a865-4a79-a5e9-d7cfdf81361a req-c3d3f522-b9d6-451e-9b36-2f80982af88b tempest-InstanceActionsV221TestJSON-991343440 tempest-InstanceActionsV221TestJSON-991343440-project-member] Enqueued Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_members [ 1133.850324] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_members [ 1133.850923] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.850923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.850923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.851857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.851857] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.851857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.851857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.851857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.851857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.851857] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.107370] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.111252] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.111399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.111596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69ee1c02-d574-466d-abbe-5676b1530fb7 with status ACTIVE [ 1134.111811] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.111905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.111998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.112441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.112586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.112732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.112869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.112904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.113076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.113159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.113352] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.113748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.113859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.114032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.114184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.114277] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69ee1c02-d574-466d-abbe-5676b1530fb7 is going to be updated. [ 1134.133371] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.133513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.133584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.133785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.133921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.134099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69ee1c02-d574-466d-abbe-5676b1530fb7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.239488] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-817 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.239679] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-817" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.239801] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-817" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.240441] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-817" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.240441] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.240612] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.240682] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.240987] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.241249] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.241574] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.241709] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.241834] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.241943] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.242082] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.242243] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.242488] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.269178] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.269498] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1134.269746] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.270067] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-817" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.270571] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-e9823534-75d3-42e4-a927-d0cadcd76d7a taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.270873] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.271174] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.271599] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.271844] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9823534-75d3-42e4-a927-d0cadcd76d7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.353866] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.353959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.354040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.354423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.354501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.354725] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.354899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.354899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.355042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.355141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.355366] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 already deleted. [ 1134.355366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.609193] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.777981] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.777981] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port e9823534-75d3-42e4-a927-d0cadcd76d7a not found, creating... [ 1134.777981] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.777981] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.778403] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.778403] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.778403] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.778516] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.779192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.779192] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: e9823534-75d3-42e4-a927-d0cadcd76d7a is going to be created. [ 1134.799313] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.799313] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.799474] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.799811] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.800114] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.800387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.112381] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.112672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.112891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.113285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.113433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.113574] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d is going to be created. [ 1135.136177] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.136312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.136383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.136590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.138221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.147117] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66798627-d216-4310-ba92-d4d31a6d6b3d in Status: UNINITIALIZED for 2s [ 1135.962804] env[69728]: INFO networking_nsxv3.common.synchronization [req-21e65506-a865-4a79-a5e9-d7cfdf81361a req-899ae995-9361-4402-a96f-8f29ea96aee4 service nova] Enqueued Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_rules [ 1135.962988] env[69728]: INFO networking_nsxv3.common.synchronization [req-21e65506-a865-4a79-a5e9-d7cfdf81361a req-899ae995-9361-4402-a96f-8f29ea96aee4 service nova] Enqueued Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_members [ 1135.963152] env[69728]: INFO networking_nsxv3.common.synchronization [req-21e65506-a865-4a79-a5e9-d7cfdf81361a req-899ae995-9361-4402-a96f-8f29ea96aee4 service nova] Enqueued Resource ID: e9823534-75d3-42e4-a927-d0cadcd76d7a with Priority: HIGHEST for action port [ 1135.963762] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_rules [ 1135.963846] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_members [ 1135.963910] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9823534-75d3-42e4-a927-d0cadcd76d7a with Priority: HIGHEST for action port [ 1135.967292] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.967436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.967523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.967734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.967820] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.968685] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.968796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.968920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.969032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.969177] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.969301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.969333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.969458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.969538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.969624] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.970368] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9823534-75d3-42e4-a927-d0cadcd76d7a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.970467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.970557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.970713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.970783] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9823534-75d3-42e4-a927-d0cadcd76d7a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.474241] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.474669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.474669] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.475654] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9823534-75d3-42e4-a927-d0cadcd76d7a with status ACTIVE [ 1136.475759] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.475868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.475934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.476159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.476252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.476435] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.476557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.476619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.476779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.476857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.477047] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.477139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.477210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.477390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.477449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.477538] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9823534-75d3-42e4-a927-d0cadcd76d7a is going to be updated. [ 1136.497570] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.497776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.497776] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.497989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.498141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.498309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9823534-75d3-42e4-a927-d0cadcd76d7a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.980110] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.155757] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66798627-d216-4310-ba92-d4d31a6d6b3d in Status: SUCCESS [ 1137.155967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.156162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.156380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.156593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.156752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.156801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.156953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.157066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.157159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.157851] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.482397] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.482397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.482397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.482830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.482830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.482830] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 is going to be created. [ 1137.506506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.506716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.506833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.507102] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.507394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.515588] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 in Status: UNINITIALIZED for 2s [ 1137.659638] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.162418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66798627-d216-4310-ba92-d4d31a6d6b3d: rpc.has_security_group_logging(os_id): False [ 1138.187893] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.188152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.188152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.188322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.188412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.188734] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.188842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.188907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.189080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.189162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.189253] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d is going to be created. [ 1138.273433] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.273585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.273652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.273865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.274048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.284607] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66798627-d216-4310-ba92-d4d31a6d6b3d in Status: IN_PROGRESS for 2s [ 1139.525990] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 in Status: SUCCESS [ 1139.526261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.526423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.526676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.526875] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.526994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.527089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.527224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.527309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.527398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.527502] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.885575] env[69728]: INFO networking_nsxv3.common.synchronization [req-532cc7d3-6827-4b5e-b5fc-96fb06cfb55c req-f1c0752e-6fab-4c0e-8657-227c5ba971b7 tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1139.886185] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1139.886821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.886821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.886821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.886988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.890234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.890234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.890234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.890234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.890234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.890234] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.031480] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.031480] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.031480] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.031480] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.031480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.032444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.032444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.032444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.032444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.032444] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.296608] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66798627-d216-4310-ba92-d4d31a6d6b3d in Status: SUCCESS [ 1140.297030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.394271] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.394498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.394608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.394906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.395735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.395735] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.395735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.395735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.395735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.395735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.396092] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1140.422158] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.422158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.422158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.423138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.423138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.431051] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1140.504787] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-746 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.505081] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.505501] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.505870] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.506620] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.506620] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.507169] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.507520] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.508049] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.508406] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.508599] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.508761] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.508920] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.509072] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1140.509600] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.509600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1140.532096] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1140.532096] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1140.532096] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1140.532096] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-746" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.532598] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f66a2473-1c15-4720-a8b2-03c34b67d220 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.532598] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.532720] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.533992] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.533992] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f66a2473-1c15-4720-a8b2-03c34b67d220',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.538219] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 159d2acb-45c2-4811-ab7d-264bdb227ed6: rpc.has_security_group_logging(os_id): False [ 1140.553365] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.553512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.553569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.557019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.557019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.557019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.557019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.557659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.557659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.557659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.557659] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 is going to be created. [ 1140.611110] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.611294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.611343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.611529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.611729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.623939] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 in Status: IN_PROGRESS for 2s [ 1140.957460] env[69728]: INFO networking_nsxv3.common.synchronization [None req-5981c338-16a6-4a13-9023-4570d870f255 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_rules [ 1140.958507] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_rules [ 1140.958507] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.958669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.958669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.958993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.959089] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.035489] env[69728]: INFO networking_nsxv3.common.synchronization [None req-7eff93ab-735f-4658-a613-e1b2ed289baf tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_rules [ 1141.036147] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.036221] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.036769] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.036769] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.036769] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.036941] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f66a2473-1c15-4720-a8b2-03c34b67d220 not found, creating... [ 1141.037191] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.037359] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.037481] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.037701] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.037844] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.038218] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.038310] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.038412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.038623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.038759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.038900] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f66a2473-1c15-4720-a8b2-03c34b67d220 is going to be created. [ 1141.040242] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_rules [ 1141.040690] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.040781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.058597] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.058597] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.058597] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.058597] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.058597] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.058895] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.481688] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.481839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.481885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.482278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.482402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.482521] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe already deleted. [ 1141.482628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.482807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.482998] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.483185] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.004436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.004847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.004847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.004847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.004989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.005077] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe already deleted. [ 1142.005179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.442898] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1142.443234] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 1142.443450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.520508] env[69728]: INFO networking_nsxv3.common.synchronization [req-532cc7d3-6827-4b5e-b5fc-96fb06cfb55c req-c0c97a64-f13b-485f-acbd-d6cac35fc090 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 1142.520726] env[69728]: INFO networking_nsxv3.common.synchronization [req-532cc7d3-6827-4b5e-b5fc-96fb06cfb55c req-c0c97a64-f13b-485f-acbd-d6cac35fc090 service nova] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1142.520883] env[69728]: INFO networking_nsxv3.common.synchronization [req-532cc7d3-6827-4b5e-b5fc-96fb06cfb55c req-c0c97a64-f13b-485f-acbd-d6cac35fc090 service nova] Enqueued Resource ID: f66a2473-1c15-4720-a8b2-03c34b67d220 with Priority: HIGHEST for action port [ 1142.521146] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_rules [ 1142.521294] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1142.521393] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f66a2473-1c15-4720-a8b2-03c34b67d220 with Priority: HIGHEST for action port [ 1142.521996] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.522122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.522213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.522450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.522534] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.523792] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.523912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.524031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.524162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.524343] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.524442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.524507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.524655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.524739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.524829] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.529639] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f66a2473-1c15-4720-a8b2-03c34b67d220 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.529742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.529815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.529971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.530078] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f66a2473-1c15-4720-a8b2-03c34b67d220',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.636856] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 in Status: SUCCESS [ 1142.637069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.032940] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.034061] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.034182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.034345] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f66a2473-1c15-4720-a8b2-03c34b67d220 with status ACTIVE [ 1143.034533] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.034641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.034706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.034901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.034990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.035176] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.035277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.035341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.035491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.035571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.035767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.035863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.035926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.036250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.036338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.036433] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f66a2473-1c15-4720-a8b2-03c34b67d220 is going to be updated. [ 1143.056832] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.056979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.057036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.057245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.057588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.057588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f66a2473-1c15-4720-a8b2-03c34b67d220" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.455289] env[69728]: INFO networking_nsxv3.common.synchronization [req-231c17fc-1dc6-482e-8bd8-35c100065514 req-96dde60b-8f9c-4022-8c37-330a3a3f1ca6 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1143.455289] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1143.455289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.455289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.455289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.455289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.455289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.455289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.455289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.455625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.455655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.455871] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.539803] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.958882] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.041793] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.042350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.042533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.042882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.043091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.043355] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1144.078278] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.078278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.078278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.078278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.078278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.084984] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1144.302718] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.302915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.303056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.303327] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.303622] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.303790] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.303915] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.304150] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.304477] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.304608] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.304810] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.304943] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.305105] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.305175] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1144.305286] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.305424] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.325726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.325892] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1144.326042] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.326230] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.326554] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-036df641-1d2c-4ccb-b1ca-b40eb4761af2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.326733] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.326856] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.327219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.327456] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('036df641-1d2c-4ccb-b1ca-b40eb4761af2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.460264] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.831576] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.831721] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.831851] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.832154] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.832400] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.832562] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 036df641-1d2c-4ccb-b1ca-b40eb4761af2 not found, creating... [ 1144.832832] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.832996] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.833132] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.837017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.837017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.837017] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.837017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.837017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.837017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.837017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.837017] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 036df641-1d2c-4ccb-b1ca-b40eb4761af2 is going to be created. [ 1144.867921] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.868133] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.868205] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.868452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.868684] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.868917] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.962710] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.962910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.962987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.963165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.963285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.963354] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be updated. [ 1145.010532] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.010700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.010763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.010942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.011101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.021307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1145.227744] env[69728]: INFO networking_nsxv3.common.synchronization [req-27fa3745-3519-4cdf-b7f4-e757419d459e req-2e156e4f-dcbb-4148-9e28-c88ac6e8760f tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1145.228620] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1145.228620] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.229356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.229356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.229356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.230164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.230164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.230164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.230164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.230164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.230164] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.731787] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.732098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.732098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.732313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.732405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.732613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.732729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.732768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.732913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.732988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.733204] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef already deleted. [ 1145.733307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.094260] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1146.094492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.094653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.094864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.095142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.095256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.095298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.095455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.095531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.095616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.095702] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.214643] env[69728]: INFO networking_nsxv3.common.synchronization [req-231c17fc-1dc6-482e-8bd8-35c100065514 req-725fdb70-8a20-44e8-a5ea-dcadf6c1f782 service nova] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1146.214823] env[69728]: INFO networking_nsxv3.common.synchronization [req-231c17fc-1dc6-482e-8bd8-35c100065514 req-725fdb70-8a20-44e8-a5ea-dcadf6c1f782 service nova] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1146.214966] env[69728]: INFO networking_nsxv3.common.synchronization [req-231c17fc-1dc6-482e-8bd8-35c100065514 req-725fdb70-8a20-44e8-a5ea-dcadf6c1f782 service nova] Enqueued Resource ID: 036df641-1d2c-4ccb-b1ca-b40eb4761af2 with Priority: HIGHEST for action port [ 1146.215521] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_rules [ 1146.215659] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1146.215757] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 036df641-1d2c-4ccb-b1ca-b40eb4761af2 with Priority: HIGHEST for action port [ 1146.216462] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.216636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.216719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.216941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.217478] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.218276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.218369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.218664] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-036df641-1d2c-4ccb-b1ca-b40eb4761af2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.218778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.218838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.219027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.219098] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('036df641-1d2c-4ccb-b1ca-b40eb4761af2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.289595] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.290896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.290896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.290896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.290896] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.290896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.290896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.290896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.291310] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.291579] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.291765] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.291884] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.291997] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.292201] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1146.292350] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.292500] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.322327] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.322643] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1146.322769] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.323056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.323518] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-cc982ed7-2d55-4682-b096-49e314f6af3f taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.323806] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.324099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.324580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.324791] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc982ed7-2d55-4682-b096-49e314f6af3f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.600176] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.600316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.600390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.600600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.600768] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.600882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.600946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.601114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.601224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.601355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.601550] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.601673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.601752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.601937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.602102] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.602200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.602260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.602412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.602488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.602568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.602656] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.719215] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.719399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.723883] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 036df641-1d2c-4ccb-b1ca-b40eb4761af2 with status ACTIVE [ 1146.724012] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.724079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.724117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.724423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.724513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.724695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.724793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.724855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.725022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.725094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.725301] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.725420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.725482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.725625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.725700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.725784] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 036df641-1d2c-4ccb-b1ca-b40eb4761af2 is going to be updated. [ 1146.745462] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.745462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.745462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.745462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.745667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.745702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-036df641-1d2c-4ccb-b1ca-b40eb4761af2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.828020] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.828289] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.828395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.828680] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.828837] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.828995] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port cc982ed7-2d55-4682-b096-49e314f6af3f not found, creating... [ 1146.829332] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.829524] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.829690] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.829918] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.830073] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.830459] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.830578] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.830658] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.830841] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.830979] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.831135] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: cc982ed7-2d55-4682-b096-49e314f6af3f is going to be created. [ 1146.851025] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.851025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.851025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.851025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.851025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.851288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.031151] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1147.031426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.031628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.031916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.032149] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.032410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.032515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.032683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.032779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.032848] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.105169] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4864eea1-2a57-4824-a279-fb7f17aef5fd: rpc.has_security_group_logging(os_id): False [ 1147.123737] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.123981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.123981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.124304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.124419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.124584] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.124681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.124745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.124902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.125045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.125193] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.125288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.125354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.125488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.125563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.125752] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.125843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.125898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.126047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.126123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.126438] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1147.187963] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.188319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.188453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.188754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.188912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.205240] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1147.227877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.228076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.228141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.228354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.228468] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.509370] env[69728]: INFO networking_nsxv3.common.synchronization [req-3a11bbbf-ffca-4614-80b4-bb80a72af4cd req-cc00a199-e5db-436c-90f3-a84cae38b360 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_members [ 1147.510733] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_members [ 1147.511839] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.511985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.516130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.516409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.516645] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.516756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.516817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.516977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.517067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.517165] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.537945] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.736675] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.822754] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.823045] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.823137] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.823367] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.823634] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.823808] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.823911] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.824153] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.824353] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.824587] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.824708] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.824824] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.824936] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.825062] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1147.825176] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.825309] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.843447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.843610] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1147.843737] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.843914] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-590" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.844246] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-8f41ad67-e205-4211-b98f-e1db33fbaffb taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.844420] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.844544] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.844857] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.845011] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f41ad67-e205-4211-b98f-e1db33fbaffb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.921134] env[69728]: INFO networking_nsxv3.common.synchronization [req-4cfec85b-2da2-48cf-9349-17995fae4436 req-b71c7077-8278-4c42-8df4-38f6ccf55023 tempest-InstanceActionsV221TestJSON-991343440 tempest-InstanceActionsV221TestJSON-991343440-project-member] Enqueued Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_members [ 1147.921679] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 with Priority: HIGHEST for action security_group_members [ 1147.921954] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-159d2acb-45c2-4811-ab7d-264bdb227ed6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.922176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.922326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.922544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.922732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.922875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.922946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.923377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.923377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.923377] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('159d2acb-45c2-4811-ab7d-264bdb227ed6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.019873] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.020139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.020254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.020607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.020696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.020990] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.021166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.021272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.021611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.021693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.021761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f already deleted. [ 1148.021891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.040238] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.240040] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.269719] env[69728]: INFO networking_nsxv3.common.synchronization [req-27fa3745-3519-4cdf-b7f4-e757419d459e req-935d2faa-cf11-4c89-a74b-dab0f4d008cd service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1148.269901] env[69728]: INFO networking_nsxv3.common.synchronization [req-27fa3745-3519-4cdf-b7f4-e757419d459e req-935d2faa-cf11-4c89-a74b-dab0f4d008cd service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1148.270054] env[69728]: INFO networking_nsxv3.common.synchronization [req-27fa3745-3519-4cdf-b7f4-e757419d459e req-935d2faa-cf11-4c89-a74b-dab0f4d008cd service nova] Enqueued Resource ID: cc982ed7-2d55-4682-b096-49e314f6af3f with Priority: HIGHEST for action port [ 1148.270665] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1148.270802] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1148.270899] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc982ed7-2d55-4682-b096-49e314f6af3f with Priority: HIGHEST for action port [ 1148.271180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.271353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.271353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.271672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.271764] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.272556] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.275496] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.275496] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.275496] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc982ed7-2d55-4682-b096-49e314f6af3f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.275496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.275496] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc982ed7-2d55-4682-b096-49e314f6af3f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.347642] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.347875] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.348024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.348294] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.348452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.348608] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 8f41ad67-e205-4211-b98f-e1db33fbaffb not found, creating... [ 1148.348869] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.349038] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.349160] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.349462] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.349530] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.349791] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.349942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.350072] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.350292] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.350424] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.350563] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 8f41ad67-e205-4211-b98f-e1db33fbaffb is going to be created. [ 1148.368326] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.368510] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.368627] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.368871] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.369103] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.369392] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.425511] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.425697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.425758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.426113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.426113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.426270] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.426447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.426447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.426608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.426713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.426801] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 is going to be updated. [ 1148.465629] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.465784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.465855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.466084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.466233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.476029] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 in Status: IN_PROGRESS for 2s [ 1148.544145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.544490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.544490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.545351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.545351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.545351] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be updated. [ 1148.579136] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.579290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.579399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.579572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.579716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.589067] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1148.747411] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1148.747519] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1148.776911] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.778069] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.778202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.779513] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc982ed7-2d55-4682-b096-49e314f6af3f with status ACTIVE [ 1148.781968] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.781968] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.781968] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.781968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.781968] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc982ed7-2d55-4682-b096-49e314f6af3f is going to be updated. [ 1148.805426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.805608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.805669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.805986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.806195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.806392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc982ed7-2d55-4682-b096-49e314f6af3f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.916156] env[69728]: INFO networking_nsxv3.common.synchronization [req-ddd8da77-c5a0-41bd-9e20-4f8d0119d090 req-3b365e5e-408f-45fb-ae4c-e7711da1656b tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1148.916735] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1148.917087] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.917203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.917263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.917463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.917613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.917720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.917777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.917922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.918012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.918150] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.089605] env[69728]: INFO networking_nsxv3.common.synchronization [req-3a11bbbf-ffca-4614-80b4-bb80a72af4cd req-92042aa2-5d8b-4560-a731-bf682f732b91 service nova] Enqueued Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_rules [ 1149.089777] env[69728]: INFO networking_nsxv3.common.synchronization [req-3a11bbbf-ffca-4614-80b4-bb80a72af4cd req-92042aa2-5d8b-4560-a731-bf682f732b91 service nova] Enqueued Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_members [ 1149.089911] env[69728]: INFO networking_nsxv3.common.synchronization [req-3a11bbbf-ffca-4614-80b4-bb80a72af4cd req-92042aa2-5d8b-4560-a731-bf682f732b91 service nova] Enqueued Resource ID: 8f41ad67-e205-4211-b98f-e1db33fbaffb with Priority: HIGHEST for action port [ 1149.091038] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_rules [ 1149.091038] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_members [ 1149.091038] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f41ad67-e205-4211-b98f-e1db33fbaffb with Priority: HIGHEST for action port [ 1149.091038] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.091038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.091349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.091349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.091349] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.092257] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.092257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.092981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.092981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.092981] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.092981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.092981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.092981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.092981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.092981] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.093801] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f41ad67-e205-4211-b98f-e1db33fbaffb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.093801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.094155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.094155] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.094155] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f41ad67-e205-4211-b98f-e1db33fbaffb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.239834] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1149.239940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.280217] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.420920] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.595511] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.596450] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.596600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.596786] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f41ad67-e205-4211-b98f-e1db33fbaffb with status ACTIVE [ 1149.596960] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.597099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.597165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.597372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.597463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.597633] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.597842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.597925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.598571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.598669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.598864] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.598960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.599034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.599179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.599260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.599347] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f41ad67-e205-4211-b98f-e1db33fbaffb is going to be updated. [ 1149.601491] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.601597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.601724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.601852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.614907] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1149.616172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.617425] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1149.643576] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.643702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.643775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.643976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.644122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.644302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f41ad67-e205-4211-b98f-e1db33fbaffb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.654142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.654320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.654378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.655391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.664358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.665206] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1149.665206] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1149.665343] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1149.704301] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.704472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.704631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.704774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.706274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.706471] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1149.783967] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.784159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.784351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.784661] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.784812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.784978] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be created. [ 1149.812555] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.812555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.812555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.812555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.812854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.813094] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1149.819313] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.819462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.819509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.819686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.819838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.827965] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: UNINITIALIZED for 2s [ 1149.887298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.887506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.887547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.887822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.888179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.888541] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1149.888641] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'843812e4-7adf-4d17-bf4b-07d845b47f68', '7481a9f3-6d05-4af7-91aa-204c1c681418', '98ee287a-374d-44ae-b682-134db3270cba', '32e70181-d90f-4f81-8e3c-980e1b53c1e6', 'fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb', 'b895038e-0ce2-442d-b804-0ba2c46948e6', '9f791dd8-c5f7-4dee-8371-74dee670bd90', '4195a4b3-a062-447e-88f8-e19488536bcf', '4a60e6b6-dc67-4740-938b-2f3c64059d3d', '70069c08-99e8-48a7-8c3c-59be136e7340', 'dafae610-4861-4852-9c85-d723484b91f0', '15661f32-f427-4619-97c6-f59aec12ec77', '17f6bb6d-e945-45d3-be21-e51b9566cda2', '744d58d1-f84e-4c36-b213-5dbf603203f4', 'f8408d52-084d-4902-9059-c9e45aefc511', '3fb31477-cec0-4034-8f2e-e510893e6ddf', '00587369-d416-4d4c-b7d8-d80624c5056b', '6e9aa9c6-847d-4842-a489-0d7e99a2f946', '42bb2c30-1996-4c07-afc8-9d69bfd16f3a', '562643dd-522c-4927-b2ad-26c57a85d1e3', '05a124ad-1f1b-4827-93f7-8088f013edda', 'c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4', '33bba7e4-2298-4997-b67a-a02ac1558aa5', '7c6e384a-728d-49a1-9e35-3c446ee4ccdd', 'dd5fc210-b40b-42fd-9bcf-e190a117ea03', 'e1bbb88c-d56a-4e1c-b39c-5f69921fcc29', '159d2acb-45c2-4811-ab7d-264bdb227ed6', '150816be-2a89-4f94-a1c1-0b956d39c86e', '3101a87a-3c2b-4957-a55a-4e83072e253c', '2cc1b947-36b1-4b46-9434-017900494d57', '1af596d4-70db-49cb-b5dd-9bb7c04a2bdc', '00e88d88-3454-4e14-8364-c48e1d31646f', 'd2c67d4e-4d10-4e52-a09a-e7c33344cd7a', '242249ee-0650-4468-83db-52fb528ae0d1', '69ded0e1-c75f-440b-abf9-1fb132e0a59a', '4864eea1-2a57-4824-a279-fb7f17aef5fd', '444c2dd6-94e3-450f-a206-be350b315f8e', '0ed04af6-5d88-4a9b-a4a4-60feb8636b45', '9274321f-9360-470e-a510-f63db8b66689', '954e79e4-ed41-40fb-8699-8b26721b1d77', '66798627-d216-4310-ba92-d4d31a6d6b3d', '82d01262-c022-4809-a7a7-19f567af2ac0', 'aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc', '5b4ce391-586f-4e43-aae8-8f6f4baf13c7'} {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1149.888750] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1149.916050] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.916050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.916050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.916050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.916050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.916050] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1149.916050] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1149.916050] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1149.923509] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.031482] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.031686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.031686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.031896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.033048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.033357] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1150.033467] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1150.033548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1150.033615] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1150.033696] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1150.033770] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGH for action security_group_rules [ 1150.033850] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGH for action security_group_rules [ 1150.033917] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGH for action security_group_rules [ 1150.033979] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGH for action security_group_rules [ 1150.034054] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGH for action security_group_rules [ 1150.034113] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGH for action security_group_rules [ 1150.034169] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGH for action security_group_rules [ 1150.034270] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGH for action security_group_rules [ 1150.034344] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGH for action security_group_rules [ 1150.034421] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGH for action security_group_rules [ 1150.034483] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGH for action security_group_rules [ 1150.034534] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGH for action security_group_rules [ 1150.034594] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGH for action security_group_rules [ 1150.034645] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGH for action security_group_rules [ 1150.034709] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGH for action security_group_rules [ 1150.034763] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGH for action security_group_rules [ 1150.034826] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGH for action security_group_rules [ 1150.034888] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGH for action security_group_rules [ 1150.034951] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGH for action security_group_rules [ 1150.035025] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGH for action security_group_rules [ 1150.035125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.101299] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.431495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.431802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.431925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.432329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.432468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.432676] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1150.464018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.464312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.464463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.464787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.465069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.474703] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1150.485421] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 in Status: SUCCESS [ 1150.485629] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 159d2acb-45c2-4811-ab7d-264bdb227ed6 deletion is rescheduled due to dependency. [ 1150.485992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-159d2acb-45c2-4811-ab7d-264bdb227ed6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.599518] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1150.600066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.600066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.600206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.600380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.600521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.600611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.600700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.600889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.600889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.601071] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.606508] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.606508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.606508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.606508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.606508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.606508] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f is going to be created. [ 1150.627311] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.628023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.628023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.628023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.628023] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.638204] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f in Status: UNINITIALIZED for 2s [ 1151.103804] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.607018] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8408d52-084d-4902-9059-c9e45aefc511: rpc.has_security_group_logging(os_id): False [ 1151.624262] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.624443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.625051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.625051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.641387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.641699] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.641816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.642222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.642222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.642222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.642390] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be updated. [ 1151.695166] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.695362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.695432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.695664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.695873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.707059] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1151.836349] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1151.836558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.836762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.837038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.837228] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.837337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.837393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.837548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.837634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.837804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.837804] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.340058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.340452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.340557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.340836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.341176] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.341713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.341807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.342021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.342265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.342845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.342845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.342845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.343320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.343538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.343701] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.343801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.343881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.344038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.344122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.344329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.344574] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.487221] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1152.487782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.637276] env[69728]: INFO networking_nsxv3.common.synchronization [req-269f145e-17c5-41aa-a3e9-7179164df42f req-388c3c32-6a72-4397-8a32-3e2bbfa03135 tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 1152.637641] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 1152.637806] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGH for action security_group_rules [ 1152.637915] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGH for action security_group_rules [ 1152.640262] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 with Priority: HIGH for action security_group_rules [ 1152.640474] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGH for action security_group_rules [ 1152.640594] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGH for action security_group_rules [ 1152.640717] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a with Priority: HIGH for action security_group_rules [ 1152.641410] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 with Priority: HIGH for action security_group_rules [ 1152.641496] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGH for action security_group_rules [ 1152.641601] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 with Priority: HIGH for action security_group_rules [ 1152.642170] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGH for action security_group_rules [ 1152.642328] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 with Priority: HIGH for action security_group_rules [ 1152.642458] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGH for action security_group_rules [ 1152.642562] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGH for action security_group_rules [ 1152.642660] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70069c08-99e8-48a7-8c3c-59be136e7340 with Priority: HIGH for action security_group_rules [ 1152.642756] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d with Priority: HIGH for action security_group_rules [ 1152.642849] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b895038e-0ce2-442d-b804-0ba2c46948e6 with Priority: HIGH for action security_group_rules [ 1152.642941] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4195a4b3-a062-447e-88f8-e19488536bcf with Priority: HIGH for action security_group_rules [ 1152.643048] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGH for action security_group_rules [ 1152.643144] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGH for action security_group_rules [ 1152.643240] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 with Priority: HIGH for action security_group_rules [ 1152.643571] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.643700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.643767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.643978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.647810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.647992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.647992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.648186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.649229] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.649229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.653204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.653309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.653382] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.654715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.654715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.654715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.654847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.654910] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.657236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f791dd8-c5f7-4dee-8371-74dee670bd90 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.657384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.657455] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.657638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.657719] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f791dd8-c5f7-4dee-8371-74dee670bd90',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.658612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.658699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.658853] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.658949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.659018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.659195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.659246] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.660081] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.660081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.660292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.660361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.660462] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42bb2c30-1996-4c07-afc8-9d69bfd16f3a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.662362] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.662480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.662552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.662719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.662798] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e9aa9c6-847d-4842-a489-0d7e99a2f946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.663814] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.663814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.663956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.664075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.664130] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.665165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-744d58d1-f84e-4c36-b213-5dbf603203f4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.665484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.665484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.666748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.666748] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('744d58d1-f84e-4c36-b213-5dbf603203f4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.666748] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.666748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.666748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.667147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.667147] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.668480] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-17f6bb6d-e945-45d3-be21-e51b9566cda2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.668480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.668480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.668480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.668765] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('17f6bb6d-e945-45d3-be21-e51b9566cda2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.669386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.670014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.670014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.670014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.670014] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.671526] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.671526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.671526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.671526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.671526] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.671819] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70069c08-99e8-48a7-8c3c-59be136e7340 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.671819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.672083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.672385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.672385] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70069c08-99e8-48a7-8c3c-59be136e7340',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.673576] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.673576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.673576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.673576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.673912] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a60e6b6-dc67-4740-938b-2f3c64059d3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.674478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b895038e-0ce2-442d-b804-0ba2c46948e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.674478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.674478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.674965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.674965] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b895038e-0ce2-442d-b804-0ba2c46948e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.675417] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4195a4b3-a062-447e-88f8-e19488536bcf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.675529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.675529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.675700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.675753] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4195a4b3-a062-447e-88f8-e19488536bcf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.676621] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.676621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.676793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.676847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.676897] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.678029] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.678029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.678029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.678262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.678262] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.680103] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.680103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.680103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.680103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.680103] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32e70181-d90f-4f81-8e3c-980e1b53c1e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.691139] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f in Status: SUCCESS [ 1152.691507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.692147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.692331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.692526] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.692638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.692703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.692861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.692940] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.693033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.693123] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.847420] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1152.865208] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.865486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.866171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.866311] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.866485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.866891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.867132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.867265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.867670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.867757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.868101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.868277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.868363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.868603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.868689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.868906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.869072] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.869180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.869426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.869558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.869735] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be created. [ 1152.923760] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.926351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.926351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.926351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.926351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.935327] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1152.974680] env[69728]: INFO networking_nsxv3.common.synchronization [req-60450a05-c960-4d15-a4f2-6612466424be req-a8f3a1be-4b00-4c48-94fc-1a9415068319 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1152.975736] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1152.976194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.976354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.976497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.976660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.976839] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.976951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.977032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.977236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.977331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.977441] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.984633] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.984851] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.985013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.985317] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.985617] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.985798] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.985947] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.986216] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.986395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.986671] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.986801] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.986949] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.987089] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.987228] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.987366] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.987533] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.014413] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.014578] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.014820] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.015118] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.015610] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-7a31dc57-54d1-471d-b17b-8907cdf504f8 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.015912] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.016155] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.016607] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.016839] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a31dc57-54d1-471d-b17b-8907cdf504f8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.181438] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.181601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.181674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.182298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.182298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.182298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.182298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.183216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.183216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.183216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.183216] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.183603] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.183713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.183772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.183923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.184305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.184305] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.184492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.184492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.184590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.184676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.184765] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be deleted. [ 1153.189872] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.189997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.190098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.190213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.190360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.190496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.190559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.191086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.191178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.191268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.191360] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.192749] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.192749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.192955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.193025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.193144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.193262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.193336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.193477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.193554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.193638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.193718] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.198466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.198638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.198638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.202019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.202019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.202019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.202019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.202019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.202596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.202596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.202596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.202596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.202596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.202596] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.207180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.207180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.207180] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.207180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.207180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.207180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.207709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.207709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.207709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.207709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.207709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.207709] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.221252] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.249909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.250529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.250529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.250529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.255834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.255967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.258179] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.258290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.260094] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.260094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.260672] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.260767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.263549] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.263549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.264614] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.264707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.265416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.265583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.266317] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.266544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.267063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.267159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.267846] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.268092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.273074] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1153.273501] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.273628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.275885] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1153.276409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.276648] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be deleted. [ 1153.277588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.277798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.279743] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.279886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.279945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.280106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.280189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.280286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.292558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.292693] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f791dd8-c5f7-4dee-8371-74dee670bd90 is going to be deleted. [ 1153.293577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.293775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.311322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.311322] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b895038e-0ce2-442d-b804-0ba2c46948e6 is going to be deleted. [ 1153.311903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.312120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.330611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.330611] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e9aa9c6-847d-4842-a489-0d7e99a2f946 is going to be deleted. [ 1153.331500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.333533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.344540] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.344540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.345145] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.345257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.350639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.351279] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42bb2c30-1996-4c07-afc8-9d69bfd16f3a is going to be deleted. [ 1153.351717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.351931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.371735] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.371859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.374992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.375129] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 17f6bb6d-e945-45d3-be21-e51b9566cda2 is going to be deleted. [ 1153.376016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.376236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.481356] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.481573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.505288] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.505430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.514473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.514629] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4195a4b3-a062-447e-88f8-e19488536bcf is going to be deleted. [ 1153.516069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.516344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.519786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.519939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.522514] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.522701] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.522830] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.523122] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.523274] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.523430] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 7a31dc57-54d1-471d-b17b-8907cdf504f8 not found, creating... [ 1153.523680] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.523839] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.523959] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.524192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.524337] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.524619] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.524777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.524896] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.525119] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.525265] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.525403] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 is going to be created. [ 1153.544345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.544536] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32e70181-d90f-4f81-8e3c-980e1b53c1e6 is going to be deleted. [ 1153.545468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.545956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.552435] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.552633] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.552761] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.553031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.553257] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.553477] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.567854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.568073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.580686] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.580849] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 744d58d1-f84e-4c36-b213-5dbf603203f4 is going to be deleted. [ 1153.585021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.585021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.622390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.622533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.623380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.623493] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be deleted. [ 1153.624405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.624641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.630780] env[69728]: INFO networking_nsxv3.common.synchronization [req-f3138c90-a103-4ea4-bf8c-3877c9fd071c req-8b880ceb-6ad9-4003-b6b8-01d1a0bde22e tempest-ServersNegativeTestJSON-132698298 tempest-ServersNegativeTestJSON-132698298-project-member] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 1153.631039] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGHEST for action security_group_members [ 1153.631593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.631710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.631775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.632373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.632373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.632373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.632373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.632628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.632628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.632718] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.652750] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.653076] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.692988] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.713354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.713500] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a60e6b6-dc67-4740-938b-2f3c64059d3d is going to be deleted. [ 1153.714327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.714553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.715485] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.716338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.716465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.716534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.716723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.716877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.716968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.717048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.717241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.717302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.717361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.717498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.717577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.717653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.717798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.717934] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.718036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.718107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.718249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.718326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.718391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.718486] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.719889] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.720017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.720384] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.720384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.720384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.720579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.721069] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.721069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.721069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.721069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.721520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.721520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.721520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.721520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.721739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.721739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.721857] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.721931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.722012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.722262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.722377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.722422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.722546] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.723316] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.724489] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.725112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.725226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.726659] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7481a9f3-6d05-4af7-91aa-204c1c681418: rpc.has_security_group_logging(os_id): False [ 1153.729084] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a77ce3ca-085e-4feb-bd39-e12a2a43bc4f: rpc.has_security_group_logging(os_id): False [ 1153.768032] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1153.768032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.768248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.768367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.768455] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.783957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.784166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.785117] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.785253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.795574] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.795747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.802117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.802721] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70069c08-99e8-48a7-8c3c-59be136e7340 is going to be deleted. [ 1153.803837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.804136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.804319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.804510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f791dd8-c5f7-4dee-8371-74dee670bd90" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.804710] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.804929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.805178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.805330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.805895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.806257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.806349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.806461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b895038e-0ce2-442d-b804-0ba2c46948e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.806655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.806836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.842270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.842270] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.842270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.842270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.842270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.842270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.842509] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1153.843304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.843671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.843671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.843671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e9aa9c6-847d-4842-a489-0d7e99a2f946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.843809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.844678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.844678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.844678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42bb2c30-1996-4c07-afc8-9d69bfd16f3a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.844678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.844884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.844915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.845049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-17f6bb6d-e945-45d3-be21-e51b9566cda2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.845182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.845381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.845442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.845693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4195a4b3-a062-447e-88f8-e19488536bcf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.845693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.845826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.845882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.845991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32e70181-d90f-4f81-8e3c-980e1b53c1e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.846152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.846298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.846369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.846489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-744d58d1-f84e-4c36-b213-5dbf603203f4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.846723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.846818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.884104] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.884312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.894714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.894992] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.895125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.895210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.895415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.895491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.895702] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.895800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.895858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.896011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.896086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.896269] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.896348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.896405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.896546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.896621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.896726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1153.897923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.898112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.898192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.898433] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.898522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.898624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.898738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.898813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.898906] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f is going to be created. [ 1153.899893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.900034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.900110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.901026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.901026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.901026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.901026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.901026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70069c08-99e8-48a7-8c3c-59be136e7340" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.930298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.930545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.930545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.930767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.930902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.931049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a60e6b6-dc67-4740-938b-2f3c64059d3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.932717] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.932932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.933046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.933414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.933658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.959470] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1154.078742] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.078742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.078742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.078937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.079172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.094124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.094413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.094413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.094683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.094843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.105395] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f in Status: IN_PROGRESS for 2s [ 1154.111828] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1154.111828] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1154.135485] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.135485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.135485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.135485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.181497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.181650] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.181815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.181868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.182087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.182265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.182451] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 1154.196671] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fb31477-cec0-4034-8f2e-e510893e6ddf: rpc.has_security_group_logging(os_id): False [ 1154.219787] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562643dd-522c-4927-b2ad-26c57a85d1e3: rpc.has_security_group_logging(os_id): False [ 1154.228663] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 843812e4-7adf-4d17-bf4b-07d845b47f68: rpc.has_security_group_logging(os_id): False [ 1154.230455] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98ee287a-374d-44ae-b682-134db3270cba: rpc.has_security_group_logging(os_id): False [ 1154.232128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dafae610-4861-4852-9c85-d723484b91f0: rpc.has_security_group_logging(os_id): False [ 1154.270753] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.270927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.271109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.271270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.272979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.273646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.273646] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.273646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.273646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.273827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.274068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.274239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.274334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.274586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.274728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.274868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.275247] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.276835] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.276954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.278693] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.278979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.284809] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.284902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.286825] env[69728]: INFO networking_nsxv3.common.synchronization [req-269f145e-17c5-41aa-a3e9-7179164df42f req-1b3870da-b952-4b90-8342-8e8aa740511d service nova] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_rules [ 1154.286999] env[69728]: INFO networking_nsxv3.common.synchronization [req-269f145e-17c5-41aa-a3e9-7179164df42f req-1b3870da-b952-4b90-8342-8e8aa740511d service nova] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 1154.287174] env[69728]: INFO networking_nsxv3.common.synchronization [req-269f145e-17c5-41aa-a3e9-7179164df42f req-1b3870da-b952-4b90-8342-8e8aa740511d service nova] Enqueued Resource ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 with Priority: HIGHEST for action port [ 1154.287987] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_rules [ 1154.288176] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 1154.288319] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 with Priority: HIGHEST for action port [ 1154.289161] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.289161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.289161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.289349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.289464] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.295625] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.295625] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.295625] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.295625] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a31dc57-54d1-471d-b17b-8907cdf504f8 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.295625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.295625] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a31dc57-54d1-471d-b17b-8907cdf504f8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.300095] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.300095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.300095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.300257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.300257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.305684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.305944] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.306044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.306105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.306270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.306341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.306430] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1154.310774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.310774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.316167] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 1154.348018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.348018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.348018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.348018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.348018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.348018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.348018] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1154.349388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.349388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.378733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.379047] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.379166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.379222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.379408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.379491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.379584] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 is going to be updated. [ 1154.380942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.381127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.415867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.416566] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.416566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.416566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.416566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.416566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.416566] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 1154.417557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.417714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.440270] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.440411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.441426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.441526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.467563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.468233] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.468233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.468233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.468443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.468443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.468667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.468721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.468980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.468980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.469202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.469202] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.469279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.469354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.469749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.469749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.469749] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be updated. [ 1154.470890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.470980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.471135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.472251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.472329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.472444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.474035] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.474150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.474194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.474349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.474468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.493954] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1154.494956] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: IN_PROGRESS for 2s [ 1154.495857] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1154.518506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.518587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.518666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.518881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.519032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.534899] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 1154.589202] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.589452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.589567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.589792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.589982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.602354] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1154.778268] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.794445] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.794586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.794794] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.796464] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a31dc57-54d1-471d-b17b-8907cdf504f8 with status ACTIVE [ 1154.796464] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.796464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.796464] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.798861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.798861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.798861] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.798861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.798861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.799242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.799242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.799341] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.799507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.799676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.799820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.799901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.800023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 is going to be updated. [ 1154.818897] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.819066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.819141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.819355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.819492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.819655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.949917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1154.950178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.282391] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8408d52-084d-4902-9059-c9e45aefc511: rpc.has_security_group_logging(os_id): False [ 1155.302056] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.324424] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.324616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.324708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.325168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.325168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.325519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.325663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.325753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.325980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.326114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.326240] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be updated. [ 1155.417528] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.417719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.418080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.418080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.418209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.435296] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1155.806087] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.806492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.806492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.806660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.806759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.807035] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be created. [ 1155.832442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.832623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.832688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.832859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.833028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.842378] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: UNINITIALIZED for 2s [ 1155.974911] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1155.975116] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 1155.975248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.121452] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f in Status: SUCCESS [ 1156.121687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.132115] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1156.132497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.324837] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 1156.325036] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 deletion is rescheduled due to dependency. [ 1156.325205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.325319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.325550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.325734] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.325850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.325915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.326081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.326165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.326252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.326413] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.326559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.326675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.326774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.326916] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.327015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.327080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.327220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.327299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.327447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.327543] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.517972] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1156.518563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.522747] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1156.522996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.525195] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: SUCCESS [ 1156.525361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.549522] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 1156.549817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.614250] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1156.614542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.830725] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15661f32-f427-4619-97c6-f59aec12ec77: rpc.has_security_group_logging(os_id): False [ 1156.849044] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.849244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.849341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.849567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.849655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.849845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.849971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.850108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.850174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.850245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.850472] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.850578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.852847] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.852847] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.852847] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be updated. [ 1156.910127] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.910127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.910127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.910127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.910127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.921586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: IN_PROGRESS for 2s [ 1157.287713] env[69728]: INFO networking_nsxv3.common.synchronization [None req-590eb06a-7fec-4eb6-ba01-c21c68066b96 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1157.288537] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1157.288775] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.288904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.289008] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.290030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.290030] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.290030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.290030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.290350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.290544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.290665] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.448764] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1157.449038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.793162] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.793320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.793394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.793618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.793690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.793893] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.793990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.794062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.794208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.794309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.794397] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be deleted. [ 1157.823337] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.823647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.823647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.823779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.823873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.823968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.852995] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: SUCCESS [ 1157.853294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.853444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.853663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.853854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.853967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.854046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.854198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.854324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.854413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.854508] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.356943] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.357956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.357956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.357956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.357956] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.357956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.357956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.357956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.358310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.358310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.358310] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.358310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.358442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.359279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.359279] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.359279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.359279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.359279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.359279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.359279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.359279] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.861441] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c57c1ff9-39aa-42db-8159-2c763d036946: rpc.has_security_group_logging(os_id): False [ 1158.880026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.880487] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.880616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.880877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.884020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.884020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.884020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.884020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.884625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.884625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.884625] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be created. [ 1158.934833] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15661f32-f427-4619-97c6-f59aec12ec77 in Status: SUCCESS [ 1158.935101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.939718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.939883] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.939971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.940232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.940449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.950073] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: IN_PROGRESS for 2s [ 1160.964724] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: SUCCESS [ 1160.964724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.239561] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c5237a5-3b86-4a4f-9fc7-661235ecbd0c req-263e72b2-646d-41bc-ba35-9ac7a6f5643b tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_members [ 1161.240173] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_members [ 1161.240520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.240695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.240735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.241009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.241205] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.241379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.241379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.241584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.241693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.241858] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.666917] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.667144] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.667276] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.667543] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.667806] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.667961] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.669443] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.669443] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.669753] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.669982] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.670115] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.670227] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.670343] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.670459] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1161.670567] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.670701] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.689092] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.689249] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1161.689391] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.689561] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.689847] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-9015f791-0028-47b3-9e32-f1eec8e1ef74 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.690021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.690148] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.690439] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.690583] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9015f791-0028-47b3-9e32-f1eec8e1ef74',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.745548] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.745746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.745822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.745988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.746087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.746289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.746462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.746462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.746684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.746771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.746860] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe already deleted. [ 1161.746941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.192484] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.192764] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.192844] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.193158] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.193326] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.193495] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 9015f791-0028-47b3-9e32-f1eec8e1ef74 not found, creating... [ 1162.193761] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.193925] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.194060] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.194325] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.194475] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.194764] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.194924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.195064] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.195305] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.195458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.195603] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 9015f791-0028-47b3-9e32-f1eec8e1ef74 is going to be created. [ 1162.217934] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.218175] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.218308] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.218978] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.219233] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.219456] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.625214] env[69728]: INFO networking_nsxv3.common.synchronization [req-9429c561-8fab-4fdc-8709-d7bcfef57417 req-2a7eee9c-0379-4470-87fa-a6379b94707a tempest-ImagesTestJSON-339111098 tempest-ImagesTestJSON-339111098-project-member] Enqueued Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1162.625795] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd with Priority: HIGHEST for action security_group_members [ 1162.625795] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4864eea1-2a57-4824-a279-fb7f17aef5fd taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.625979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.625979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.626170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.626755] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.626755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.626755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.626755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.626755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.626755] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4864eea1-2a57-4824-a279-fb7f17aef5fd',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.128924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.129059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.133022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.133022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.138070] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c5237a5-3b86-4a4f-9fc7-661235ecbd0c req-5e4fdc62-43ff-4500-99ab-0348119af5aa service nova] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_rules [ 1163.138475] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c5237a5-3b86-4a4f-9fc7-661235ecbd0c req-5e4fdc62-43ff-4500-99ab-0348119af5aa service nova] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_members [ 1163.138475] env[69728]: INFO networking_nsxv3.common.synchronization [req-0c5237a5-3b86-4a4f-9fc7-661235ecbd0c req-5e4fdc62-43ff-4500-99ab-0348119af5aa service nova] Enqueued Resource ID: 9015f791-0028-47b3-9e32-f1eec8e1ef74 with Priority: HIGHEST for action port [ 1163.138631] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_rules [ 1163.138743] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_members [ 1163.138836] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9015f791-0028-47b3-9e32-f1eec8e1ef74 with Priority: HIGHEST for action port [ 1163.139483] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.139607] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.139702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.139860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.139937] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.140787] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.140926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.140961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.141123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.141259] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.141348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.141404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.141538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.141612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.141721] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.142426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9015f791-0028-47b3-9e32-f1eec8e1ef74 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.142540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.142585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.142724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.142790] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9015f791-0028-47b3-9e32-f1eec8e1ef74',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.148293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.148421] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.148421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.148572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.148693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.148773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.148829] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd is going to be updated. [ 1163.175548] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.175548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.175548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.175548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.175548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.182497] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: IN_PROGRESS for 2s [ 1163.644584] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.644994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.645048] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.645956] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9015f791-0028-47b3-9e32-f1eec8e1ef74 with status ACTIVE [ 1163.646164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.646277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.646347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.646575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.646669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.646849] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.646985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.647031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.647166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.647249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.647422] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.647542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.647578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.647702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.647774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.647856] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9015f791-0028-47b3-9e32-f1eec8e1ef74 is going to be updated. [ 1163.668025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.668025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.668025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.668323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.668382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.668605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9015f791-0028-47b3-9e32-f1eec8e1ef74" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.047230] env[69728]: INFO networking_nsxv3.common.synchronization [req-372bc4f1-ddd4-406b-acfb-cffe18ce8bfc req-ef40be96-d384-48e8-93d3-1b72384a5aee tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 1164.048084] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGHEST for action security_group_members [ 1164.048273] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.048375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.048434] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.048633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.048797] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.048896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.048958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.049125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.049209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.049303] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.088926] env[69728]: INFO networking_nsxv3.common.synchronization [req-372bc4f1-ddd4-406b-acfb-cffe18ce8bfc req-ef40be96-d384-48e8-93d3-1b72384a5aee tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 with Priority: HIGHEST for action port [ 1164.089416] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 with Priority: HIGHEST for action port [ 1164.089719] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a31dc57-54d1-471d-b17b-8907cdf504f8 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.089839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.089907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.090564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.090656] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a31dc57-54d1-471d-b17b-8907cdf504f8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.149653] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.552598] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.552795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.552880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.553179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.553278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.553517] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.553628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.553703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.553896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.553941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.554055] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be updated. [ 1164.579591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.579756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.579817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.580048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.580206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.592851] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: IN_PROGRESS for 2s [ 1164.594181] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a31dc57-54d1-471d-b17b-8907cdf504f8 with status ACTIVE [ 1164.594421] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.596126] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.596126] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.596126] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.596126] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a31dc57-54d1-471d-b17b-8907cdf504f8 is going to be updated. [ 1164.621737] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.621906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.622024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.622226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.622378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.622543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a31dc57-54d1-471d-b17b-8907cdf504f8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.653394] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.653722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.653773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.654672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.654672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.654672] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe is going to be created. [ 1164.675889] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.676091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.676091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.676300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.676483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.684952] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe in Status: UNINITIALIZED for 2s [ 1165.193965] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd in Status: SUCCESS [ 1165.194231] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4864eea1-2a57-4824-a279-fb7f17aef5fd deletion is rescheduled due to dependency. [ 1165.194402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4864eea1-2a57-4824-a279-fb7f17aef5fd" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.602393] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c57c1ff9-39aa-42db-8159-2c763d036946 in Status: SUCCESS [ 1166.602703] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 deletion is rescheduled due to dependency. [ 1166.602703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.693879] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe in Status: SUCCESS [ 1166.694130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.694372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.694630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.695213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.695213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.695213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.695213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.695730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.695730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.695730] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.197233] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.469627] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.469901] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.470111] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.471059] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.471355] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.471525] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.471663] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.471916] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.472080] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.472373] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.472458] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.472673] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.472673] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.472782] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1167.473314] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.473314] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.496230] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.496620] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1167.497060] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.497060] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.497252] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f411abf8-c014-4252-8cb9-6ccc30296fd2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.497510] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.497670] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.498009] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.498198] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f411abf8-c014-4252-8cb9-6ccc30296fd2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.704511] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a4af946-c7c2-473b-b227-a6d089cb1abe: rpc.has_security_group_logging(os_id): False [ 1167.729335] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.729698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.729698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.729904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.729982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.730251] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.730381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.730461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.730642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.730764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.730847] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe is going to be created. [ 1167.794679] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.794848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.794906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.795143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.795332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.810967] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe in Status: IN_PROGRESS for 2s [ 1168.001425] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.002494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.002494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.002494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.002494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.002494] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port f411abf8-c014-4252-8cb9-6ccc30296fd2 not found, creating... [ 1168.003179] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.003179] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.003179] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.003179] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.003385] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.003625] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.003778] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.003897] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.004117] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.004262] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.004459] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 is going to be created. [ 1168.025559] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.025835] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.026025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.026318] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.026641] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.026857] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.755522] env[69728]: INFO networking_nsxv3.common.synchronization [req-f54d497d-d234-44c7-99df-b7ff4b7615e7 req-07512d0e-4aea-4d70-9cd8-8fd70303b0a0 service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1168.755849] env[69728]: INFO networking_nsxv3.common.synchronization [req-f54d497d-d234-44c7-99df-b7ff4b7615e7 req-07512d0e-4aea-4d70-9cd8-8fd70303b0a0 service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1168.755849] env[69728]: INFO networking_nsxv3.common.synchronization [req-f54d497d-d234-44c7-99df-b7ff4b7615e7 req-07512d0e-4aea-4d70-9cd8-8fd70303b0a0 service nova] Enqueued Resource ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 with Priority: HIGHEST for action port [ 1168.756082] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1168.756223] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1168.756321] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 with Priority: HIGHEST for action port [ 1168.756908] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.757327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.757440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.757674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.757788] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.759031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.759143] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.759259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.759467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.759652] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.759783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.759858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.760045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.760166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.760280] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.761061] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f411abf8-c014-4252-8cb9-6ccc30296fd2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.761205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.761304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.761491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.761615] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f411abf8-c014-4252-8cb9-6ccc30296fd2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.263939] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.263939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.263939] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.264806] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f411abf8-c014-4252-8cb9-6ccc30296fd2 with status ACTIVE [ 1169.264806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.264806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.264935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.265345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.265345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.265482] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.265482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.265573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.266025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.266025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.266596] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.266701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.266894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.266894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.267022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.267110] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 is going to be updated. [ 1169.305298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.305298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.305429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.306053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.306053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.306053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.769380] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.822504] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe in Status: SUCCESS [ 1169.822870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.272202] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.272352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.272352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.272660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.272660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.272727] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be created. [ 1170.279224] env[69728]: INFO networking_nsxv3.common.synchronization [req-75c2cddd-03a2-439b-9bec-c96f836f9e0f req-1a3b6402-86da-484b-bb81-25cf40b0ef7f tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1170.279520] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1170.279823] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.279941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.280021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.280202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.280353] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.280451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.280512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.280662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.280744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.280836] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.295151] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.295360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.295454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.295633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.295795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.308357] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: UNINITIALIZED for 2s [ 1170.420139] env[69728]: INFO networking_nsxv3.common.synchronization [req-b16dd059-82d9-4568-a4d6-f3ae486b332d req-724d7b11-9195-47b4-9162-faf0e5cba153 tempest-ServersAdminTestJSON-2106607194 tempest-ServersAdminTestJSON-2106607194-project-member] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1170.420707] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGHEST for action security_group_members [ 1170.421713] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.421879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.421971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.422423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.422503] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.422616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.422674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.422873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.422956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.423071] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.731771] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-712 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.731965] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.732107] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.732470] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.734324] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.734619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.734758] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.735012] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.735179] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.735489] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.735693] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.735821] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.735940] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.736074] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1170.736190] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.736361] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.753518] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.753675] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1170.753815] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.753982] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.754911] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-fba59485-6420-4cbf-a95e-3c758aaee7d3 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.755018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.755112] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.755616] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.755616] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fba59485-6420-4cbf-a95e-3c758aaee7d3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.783545] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.783848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.783848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.783923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.784014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.784204] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.785026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.785026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.785026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.785026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.785026] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1170.808117] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.808264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.808317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.808491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.808627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.816022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1170.925770] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.925942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.926025] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.926244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.926336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.926540] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.926634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.926698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.928033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.928033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.928033] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be updated. [ 1170.955026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.955026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.955026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.955491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.955491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.963331] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: IN_PROGRESS for 2s [ 1171.258117] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.258357] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.259019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.259019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.259019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.259197] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port fba59485-6420-4cbf-a95e-3c758aaee7d3 not found, creating... [ 1171.259363] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.259524] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.259644] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.259867] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.260102] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.260307] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.260582] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.260735] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.261083] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.261322] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.261563] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: fba59485-6420-4cbf-a95e-3c758aaee7d3 is going to be created. [ 1171.283465] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.283671] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.283828] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.284099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.284348] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.284595] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.127109] env[69728]: INFO networking_nsxv3.common.synchronization [req-75c2cddd-03a2-439b-9bec-c96f836f9e0f req-6f428f69-80f6-40fb-ba95-44268cf3b147 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 1172.127362] env[69728]: INFO networking_nsxv3.common.synchronization [req-75c2cddd-03a2-439b-9bec-c96f836f9e0f req-6f428f69-80f6-40fb-ba95-44268cf3b147 service nova] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1172.127416] env[69728]: INFO networking_nsxv3.common.synchronization [req-75c2cddd-03a2-439b-9bec-c96f836f9e0f req-6f428f69-80f6-40fb-ba95-44268cf3b147 service nova] Enqueued Resource ID: fba59485-6420-4cbf-a95e-3c758aaee7d3 with Priority: HIGHEST for action port [ 1172.127618] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_rules [ 1172.127822] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1172.127881] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fba59485-6420-4cbf-a95e-3c758aaee7d3 with Priority: HIGHEST for action port [ 1172.128478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.128543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.128581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.129214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.129214] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.131547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.131547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.131547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-fba59485-6420-4cbf-a95e-3c758aaee7d3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.131547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.131547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.131802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.131802] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fba59485-6420-4cbf-a95e-3c758aaee7d3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.315478] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1172.315737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.315901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.316104] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.316299] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.316421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.316520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.316631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.316711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.316794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.316883] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.639917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.639917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fba59485-6420-4cbf-a95e-3c758aaee7d3 with status ACTIVE [ 1172.639917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.639917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.639917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.639917] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.640447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.640447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.640447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.640447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.640447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fba59485-6420-4cbf-a95e-3c758aaee7d3 is going to be updated. [ 1172.660213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.660398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.660532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.660721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.660842] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.660947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fba59485-6420-4cbf-a95e-3c758aaee7d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.706214] env[69728]: INFO networking_nsxv3.common.synchronization [req-37205983-f9dc-442f-93d2-81e5ad91f2f3 req-94f76678-0adb-45b5-8a9f-902dbc7cef87 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1172.706814] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1172.707149] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.707284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.707360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.707540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.707704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.707802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.707865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.708015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.708150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.708301] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.818762] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.818928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.818970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.819666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.819666] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.819803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.819838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.820018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.820309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.820412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.820568] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.820664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.820792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.820871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.821016] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.821110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.821379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.821379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.821379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.821541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.821541] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.830639] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1172.830748] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 1172.830853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.831032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.831345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.831536] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.831799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.831799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.832147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.832147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.832329] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.973712] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 in Status: SUCCESS [ 1172.973917] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 deletion is rescheduled due to dependency. [ 1172.973991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.213316] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.213663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.213663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.214563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.214613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.214882] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.214999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.215080] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.215280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.215375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.215472] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1173.254101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.254101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.254101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.254101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.254101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.262252] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1173.323484] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00587369-d416-4d4c-b7d8-d80624c5056b: rpc.has_security_group_logging(os_id): False [ 1173.334508] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.340987] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.341158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.341251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.341439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.341718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.341945] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.342068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.342135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.342317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.342389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.342569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.342662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.342724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.342864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.342966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.343187] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.343281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.343340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.343489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.343567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.343648] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be created. [ 1173.401713] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.401832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.401908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.402189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.402325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.411851] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1173.836572] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.339103] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.339437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.339437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.339585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.339730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.339790] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1174.389185] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.389378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.389378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.389580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.389724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.404287] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1175.272463] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1175.272652] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 deletion is rescheduled due to dependency. [ 1175.272770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.423475] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1175.423890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.413196] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1176.413415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.413580] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.413796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.413985] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.414115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.414181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.414553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.414664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.414770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.414864] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.646201] env[69728]: INFO networking_nsxv3.common.synchronization [None req-4532e1ed-d1b3-4609-9d19-03b7394a2a45 None None] Enqueued Resource ID: d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01 with Priority: HIGHEST for action port [ 1176.646717] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01 with Priority: HIGHEST for action port [ 1176.647034] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.647163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.647259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.647493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.647581] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.917428] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.917652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.917748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.917969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.918160] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.918343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.918343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.918523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.918612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.918704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.918854] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.918948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.919038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.919236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.919387] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.919474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.919532] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.919676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.919752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.919832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.919921] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.027597] env[69728]: INFO networking_nsxv3.common.synchronization [req-79204ee5-ccc2-47a1-b196-01f8d32e5a63 req-768a9ba2-3c8d-4779-9d0b-f5d6c418c312 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1177.029579] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1177.030595] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.030595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.030595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.030787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.030946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.031046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.031107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.031249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.031333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.031428] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.079305] env[69728]: INFO networking_nsxv3.common.synchronization [req-7afa1ac2-63da-4ebf-acd7-999ebdf322ae req-f4787ffb-afe6-4f0c-9e20-141a0b807102 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1177.079937] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1177.080319] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.080444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.080518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.080724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.080873] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.080968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.081184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.082018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.082018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.082018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.152776] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01 [ 1177.152957] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.153032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.153105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.153345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.153432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.154154] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01 already deleted. [ 1177.154154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5efe0ec-b5f7-44f6-b4a2-bc5e57355c01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.422760] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc: rpc.has_security_group_logging(os_id): False [ 1177.442424] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.442424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.442533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.443205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.443205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.443205] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.443205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.443205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.443411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.444060] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.444060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.444060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.444060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.444266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.444348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.444408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.444567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.444936] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1177.503765] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.503919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.503985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.504213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.504459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.517256] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1177.536500] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.536500] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.536500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.536500] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1177.586945] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.586945] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.586945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.586945] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be deleted. [ 1177.602286] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.602286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.602286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.602286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.602286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.608913] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1177.622446] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.622446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.622446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.622446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.622446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.622446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.795927] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.796260] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.796260] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.799020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.799020] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.799020] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.799653] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.799970] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.800150] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.800373] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.800492] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.800605] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.800719] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.800832] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1177.800936] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.801231] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.830046] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.830310] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1177.830431] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.830710] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.831491] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-6ab40f90-e464-4cb1-9179-b486ce2058eb taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.831710] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.831847] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.832185] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.832367] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab40f90-e464-4cb1-9179-b486ce2058eb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.340101] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.340101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.340101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.340101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.340101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.340101] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 6ab40f90-e464-4cb1-9179-b486ce2058eb not found, creating... [ 1178.341541] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.341541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.341541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.341541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.341541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.341892] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.341892] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.342064] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.342595] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.342649] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.342977] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 6ab40f90-e464-4cb1-9179-b486ce2058eb is going to be created. [ 1178.351210] env[69728]: INFO networking_nsxv3.common.synchronization [req-2f7961e3-c1f5-4e56-bf5e-8df3deff0131 req-c0794f1c-79c8-438c-a4b8-0b49ad180319 tempest-ServersV294TestFqdnHostnames-1182635706 tempest-ServersV294TestFqdnHostnames-1182635706-project-member] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_members [ 1178.351475] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGHEST for action security_group_members [ 1178.352063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.352187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.352273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.352468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.352617] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.352726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.352766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.352910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.352989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.353102] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.363585] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.367018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.367018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.367018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.367018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.367018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.703315] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b51f48ac-7580-4ee7-9d9f-d37655be5f52 None None] Enqueued Resource ID: 2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7 with Priority: HIGHEST for action port [ 1178.703602] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7 with Priority: HIGHEST for action port [ 1178.704422] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.704559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.704627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.705011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.705093] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.856328] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.856328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.856328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.856885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.856885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.856885] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.856885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.857063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.857131] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.857190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.857267] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 is going to be updated. [ 1178.883789] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.883880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.883958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.884185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.884477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.892887] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: IN_PROGRESS for 2s [ 1179.207717] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7 [ 1179.207717] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.207717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.207717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.208836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.209099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.209312] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7 already deleted. [ 1179.209587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e93e71d-bc0a-46b6-bc85-f1f7c30c68c7" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.304138] env[69728]: INFO networking_nsxv3.common.synchronization [req-25212443-e274-44bc-b58a-213dcf1ebf99 req-7abf1f98-7d43-46b6-8d55-2d4f20d97aa6 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1179.304376] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1179.305250] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.305533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.305718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.306015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.306275] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.308031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.308031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.308031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.308031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.308031] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.361154] env[69728]: INFO networking_nsxv3.common.synchronization [req-7afa1ac2-63da-4ebf-acd7-999ebdf322ae req-3736a8aa-3127-4460-b8bd-c06630ae343b service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1179.361154] env[69728]: INFO networking_nsxv3.common.synchronization [req-7afa1ac2-63da-4ebf-acd7-999ebdf322ae req-3736a8aa-3127-4460-b8bd-c06630ae343b service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1179.361154] env[69728]: INFO networking_nsxv3.common.synchronization [req-7afa1ac2-63da-4ebf-acd7-999ebdf322ae req-3736a8aa-3127-4460-b8bd-c06630ae343b service nova] Enqueued Resource ID: 6ab40f90-e464-4cb1-9179-b486ce2058eb with Priority: HIGHEST for action port [ 1179.361154] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1179.361154] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1179.361154] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab40f90-e464-4cb1-9179-b486ce2058eb with Priority: HIGHEST for action port [ 1179.361154] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.361154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.361154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.362170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.362584] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.364088] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.364366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.367018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.367018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.367018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab40f90-e464-4cb1-9179-b486ce2058eb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.367018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.367018] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab40f90-e464-4cb1-9179-b486ce2058eb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.535525] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1179.538349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.618466] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1179.618668] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf deletion is rescheduled due to dependency. [ 1179.618749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.642666] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.645017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.645017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.645017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.645017] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.645017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.645017] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.645273] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.645528] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.646062] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.646270] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.646471] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.646668] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.646896] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1179.647107] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.647323] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.664225] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.664418] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1179.664571] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.664744] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.665068] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-758d8102-a1c2-441d-a527-f3f964bf61dc taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.665258] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.665377] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.665740] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.666806] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('758d8102-a1c2-441d-a527-f3f964bf61dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.808553] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.869298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.869601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.869601] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.871596] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ab40f90-e464-4cb1-9179-b486ce2058eb with status ACTIVE [ 1179.871596] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.871596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.871596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.871596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.871596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.871596] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.871596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.871596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.872085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.872085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.872085] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.872085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.873108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.873720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.873720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.874726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ab40f90-e464-4cb1-9179-b486ce2058eb is going to be updated. [ 1179.894807] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.894912] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.895010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.895207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.895368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.895539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab40f90-e464-4cb1-9179-b486ce2058eb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.168748] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.168977] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.169128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.169413] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.169564] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.169720] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 758d8102-a1c2-441d-a527-f3f964bf61dc not found, creating... [ 1180.169979] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.170204] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.170333] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.170553] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.170750] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.171101] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.171277] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.171397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.171610] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.171745] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.171889] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 758d8102-a1c2-441d-a527-f3f964bf61dc is going to be created. [ 1180.195031] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.195031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.195031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.195031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.195031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.195031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.311863] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.343055] env[69728]: INFO networking_nsxv3.common.synchronization [None req-a658ea66-335e-44e1-aa4a-08dec958b8eb None None] Enqueued Resource ID: 0f0113a1-ab0a-4bfd-b78c-dcc45b9de541 with Priority: HIGHEST for action port [ 1180.343534] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f0113a1-ab0a-4bfd-b78c-dcc45b9de541 with Priority: HIGHEST for action port [ 1180.344038] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f0113a1-ab0a-4bfd-b78c-dcc45b9de541 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.344162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f0113a1-ab0a-4bfd-b78c-dcc45b9de541" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.344386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f0113a1-ab0a-4bfd-b78c-dcc45b9de541" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.344515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f0113a1-ab0a-4bfd-b78c-dcc45b9de541" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.348020] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f0113a1-ab0a-4bfd-b78c-dcc45b9de541',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.376843] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.815534] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.815660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.815855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.815922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.816030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.816152] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1180.846431] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f0113a1-ab0a-4bfd-b78c-dcc45b9de541 [ 1180.846431] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.846431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.847757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.847757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.847757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.847900] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f0113a1-ab0a-4bfd-b78c-dcc45b9de541 already deleted. [ 1180.847988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f0113a1-ab0a-4bfd-b78c-dcc45b9de541" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.849201] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.849357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.849357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.849582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.849627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.859680] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1180.882198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.882720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.882720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.882720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.882861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.882861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be created. [ 1180.899531] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 in Status: SUCCESS [ 1180.899745] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 deletion is rescheduled due to dependency. [ 1180.899856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.906622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.906714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.906814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.906982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.907168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.919400] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: UNINITIALIZED for 2s [ 1181.152242] env[69728]: INFO networking_nsxv3.common.synchronization [req-25212443-e274-44bc-b58a-213dcf1ebf99 req-02b97741-24c9-4c2a-9ae7-cfabedbbb94d service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1181.152346] env[69728]: INFO networking_nsxv3.common.synchronization [req-25212443-e274-44bc-b58a-213dcf1ebf99 req-02b97741-24c9-4c2a-9ae7-cfabedbbb94d service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1181.152479] env[69728]: INFO networking_nsxv3.common.synchronization [req-25212443-e274-44bc-b58a-213dcf1ebf99 req-02b97741-24c9-4c2a-9ae7-cfabedbbb94d service nova] Enqueued Resource ID: 758d8102-a1c2-441d-a527-f3f964bf61dc with Priority: HIGHEST for action port [ 1181.152718] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1181.152846] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1181.152943] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758d8102-a1c2-441d-a527-f3f964bf61dc with Priority: HIGHEST for action port [ 1181.154990] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.154990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.154990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.154990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.154990] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.160661] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.160778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.160976] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-758d8102-a1c2-441d-a527-f3f964bf61dc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.161934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.161934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.161934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.161934] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('758d8102-a1c2-441d-a527-f3f964bf61dc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.663342] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.664501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.664713] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 758d8102-a1c2-441d-a527-f3f964bf61dc with status ACTIVE [ 1181.664903] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.665021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.665090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.665299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.665411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.665581] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.665678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.665739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.665959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.665959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.666167] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.666264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.666326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.667038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.667163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.667282] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 758d8102-a1c2-441d-a527-f3f964bf61dc is going to be updated. [ 1181.686492] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.686836] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.686915] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.687149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.687287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.687448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-758d8102-a1c2-441d-a527-f3f964bf61dc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.728684] env[69728]: INFO networking_nsxv3.common.synchronization [None req-27aec547-eb11-4c13-b112-775303d3a291 None None] Enqueued Resource ID: 7e7bcacf-3149-48e5-874f-3500d078e2ad with Priority: HIGHEST for action port [ 1182.729251] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e7bcacf-3149-48e5-874f-3500d078e2ad with Priority: HIGHEST for action port [ 1182.729630] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e7bcacf-3149-48e5-874f-3500d078e2ad taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.729848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e7bcacf-3149-48e5-874f-3500d078e2ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.729890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e7bcacf-3149-48e5-874f-3500d078e2ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.734059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e7bcacf-3149-48e5-874f-3500d078e2ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.734163] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e7bcacf-3149-48e5-874f-3500d078e2ad',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.869045] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1182.869284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.869447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.869662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.869844] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.869956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.870036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.870207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.870290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.870387] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.928418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.930082] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.930082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.930082] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.239730] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e7bcacf-3149-48e5-874f-3500d078e2ad [ 1183.239958] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.240127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.240272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.240415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.240632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.240632] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e7bcacf-3149-48e5-874f-3500d078e2ad already deleted. [ 1183.240705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e7bcacf-3149-48e5-874f-3500d078e2ad" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.376400] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.435970] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.436195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.436266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.436508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.437132] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.437132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.437132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.437132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.438237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.438237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.438237] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.438237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.438237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.438237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.438237] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.438654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.438654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.438723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.438822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.438921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.439085] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.880222] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.946431] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb: rpc.has_security_group_logging(os_id): False [ 1183.963781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.964127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.964127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.964259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.964303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.964527] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.964624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.964679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.964829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.964901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.965097] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.966359] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.966359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.966359] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be created. [ 1184.016205] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.016365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.016460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.016660] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.016861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.027508] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1184.330651] env[69728]: INFO networking_nsxv3.common.synchronization [req-a66f6702-dc24-4258-b0e0-d95cc519ba3c req-788ed581-849f-4107-8153-4f2f10c7dbc6 tempest-ServerDiskConfigTestJSON-1385337453 tempest-ServerDiskConfigTestJSON-1385337453-project-member] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1184.331728] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGHEST for action security_group_members [ 1184.332551] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.332551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.332694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.333145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.334185] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.334438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.334496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.334699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.334810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.334944] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.390398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.390398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.390398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.390398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.390398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.390398] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1184.421790] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.422015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.422200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.422505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.422783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.433559] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1184.837495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.837688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.837879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.838036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.838088] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.838277] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.838373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.838458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.838619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.838701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.838789] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be updated. [ 1184.865414] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.865589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.865626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.865811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.866020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.873516] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: IN_PROGRESS for 2s [ 1185.394257] env[69728]: INFO networking_nsxv3.common.synchronization [req-0117e53f-172f-4a3a-b565-8686a084cea2 req-8132ff07-a24b-4dcc-8d90-c3ce24cd0929 tempest-ServersTestJSON-923810699 tempest-ServersTestJSON-923810699-project-member] Enqueued Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_members [ 1185.394785] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66798627-d216-4310-ba92-d4d31a6d6b3d with Priority: HIGHEST for action security_group_members [ 1185.396859] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-66798627-d216-4310-ba92-d4d31a6d6b3d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.396859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.397075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.397123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.397359] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.397452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.397541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.397857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.397920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.398010] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66798627-d216-4310-ba92-d4d31a6d6b3d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.900405] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.900602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.900707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.900939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.923073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.923296] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.923409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.923614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.923666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.923746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.923842] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d is going to be updated. [ 1185.945478] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.945970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.946068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.946285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.946425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.955790] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66798627-d216-4310-ba92-d4d31a6d6b3d in Status: IN_PROGRESS for 2s [ 1186.045735] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1186.045735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.444032] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1186.444317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.444794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.445018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.445249] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.445316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.445380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.445533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.445616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.445701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.445790] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.883550] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc in Status: SUCCESS [ 1186.883741] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc deletion is rescheduled due to dependency. [ 1186.883862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.940601] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-757 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.940816] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.940945] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.941238] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.941516] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.941742] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.941958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.942244] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.942378] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.942675] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.942796] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.942942] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.943479] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.943479] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.943479] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.943479] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.947995] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.948193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.948276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.948466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.948647] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.948744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.948808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.949123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.949292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.949399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.949585] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.949670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.949765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.949913] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.950239] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.950344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.950407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.950554] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.950636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.950715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.950808] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.960301] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.960535] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.960700] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.961073] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-757" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.961236] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-f411abf8-c014-4252-8cb9-6ccc30296fd2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.961506] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.961574] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.961899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.962087] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f411abf8-c014-4252-8cb9-6ccc30296fd2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.453582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1187.468461] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.468756] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.468978] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.469455] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.469606] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.470015] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.470245] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.470408] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.470726] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.470986] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.471611] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.471611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.471719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.473594] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.473594] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.473594] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 is going to be updated. [ 1187.476029] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.476029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.476162] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.476574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.476574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.477322] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.477322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.477430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.477680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.477680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.477905] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.477973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.478178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.478178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.478463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.478463] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.478543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.478652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.480235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.480362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.480482] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1187.504943] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.505927] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.505927] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.505927] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.505927] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.506199] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.551488] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.551644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.551718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.551938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.552166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.568041] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1187.670618] env[69728]: INFO networking_nsxv3.common.synchronization [req-17ee9ee6-0c3b-407f-9e45-cf82f71227da req-c160c222-8d4e-4e0c-97ff-26dbe7e0b976 tempest-ServersNegativeTestMultiTenantJSON-1319440590 tempest-ServersNegativeTestMultiTenantJSON-1319440590-project-member] Enqueued Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_members [ 1187.671180] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_members [ 1187.671492] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.671621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.671690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.671939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.673215] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.673344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.673418] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.673589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.673678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.673778] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.966193] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66798627-d216-4310-ba92-d4d31a6d6b3d in Status: SUCCESS [ 1187.966193] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66798627-d216-4310-ba92-d4d31a6d6b3d deletion is rescheduled due to dependency. [ 1187.966193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66798627-d216-4310-ba92-d4d31a6d6b3d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.177523] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.177523] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.177523] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 already deleted. [ 1188.177523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.240409] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-988 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.240599] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-988" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.240634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-988" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.240942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-988" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.241377] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.241377] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.241600] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.241692] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.241840] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.242420] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.242604] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.242755] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.242897] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.243285] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.243630] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.243826] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.261648] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.261843] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.261992] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.262194] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-988" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.262543] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-2ba79e78-f60a-4886-a4e5-49e92151d3ea taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.262735] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.262861] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.263189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.263337] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba79e78-f60a-4886-a4e5-49e92151d3ea',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.549731] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d1e8622-f592-41ed-82ce-6982284c622e req-56db3386-6457-4fcd-927a-539698113c48 service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1188.550059] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d1e8622-f592-41ed-82ce-6982284c622e req-56db3386-6457-4fcd-927a-539698113c48 service nova] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1188.553977] env[69728]: INFO networking_nsxv3.common.synchronization [req-8d1e8622-f592-41ed-82ce-6982284c622e req-56db3386-6457-4fcd-927a-539698113c48 service nova] Enqueued Resource ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 with Priority: HIGHEST for action port [ 1188.553977] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_rules [ 1188.553977] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1188.553977] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 with Priority: HIGHEST for action port [ 1188.553977] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.553977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.553977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.553977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.553977] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.554969] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.554969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.554969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.555108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.555326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.555895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.555895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.555895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.556096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.556605] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.563636] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-f411abf8-c014-4252-8cb9-6ccc30296fd2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.563636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.563636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.563636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.563636] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f411abf8-c014-4252-8cb9-6ccc30296fd2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.767813] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.771130] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 2ba79e78-f60a-4886-a4e5-49e92151d3ea not found, creating... [ 1188.771130] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.771130] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.771468] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.771899] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.772288] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.772618] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.772853] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.773095] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 2ba79e78-f60a-4886-a4e5-49e92151d3ea is going to be created. [ 1188.793430] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.793430] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.793430] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.793710] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.793950] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.794228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.063031] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.064781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.065045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.065230] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f411abf8-c014-4252-8cb9-6ccc30296fd2 with status ACTIVE [ 1189.065524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.065524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.065666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.065768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.065856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.066051] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.066154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.066242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.066380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.066507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.066645] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.066772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.066855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.067049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.067132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.067219] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f411abf8-c014-4252-8cb9-6ccc30296fd2 is going to be updated. [ 1189.087453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.087624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.087666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.087875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.088063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.088234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f411abf8-c014-4252-8cb9-6ccc30296fd2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.558788] env[69728]: INFO networking_nsxv3.common.synchronization [req-17ee9ee6-0c3b-407f-9e45-cf82f71227da req-927fccaf-0240-49e9-82fb-655a82b96c0b service nova] Enqueued Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_rules [ 1189.558788] env[69728]: INFO networking_nsxv3.common.synchronization [req-17ee9ee6-0c3b-407f-9e45-cf82f71227da req-927fccaf-0240-49e9-82fb-655a82b96c0b service nova] Enqueued Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_members [ 1189.558982] env[69728]: INFO networking_nsxv3.common.synchronization [req-17ee9ee6-0c3b-407f-9e45-cf82f71227da req-927fccaf-0240-49e9-82fb-655a82b96c0b service nova] Enqueued Resource ID: 2ba79e78-f60a-4886-a4e5-49e92151d3ea with Priority: HIGHEST for action port [ 1189.559293] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_rules [ 1189.559448] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_members [ 1189.559549] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ba79e78-f60a-4886-a4e5-49e92151d3ea with Priority: HIGHEST for action port [ 1189.565210] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.565370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.565433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.565747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.565838] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.572246] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.572246] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.572246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.572246] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.572733] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ba79e78-f60a-4886-a4e5-49e92151d3ea taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.572733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.572733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.572903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.572903] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ba79e78-f60a-4886-a4e5-49e92151d3ea',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.574266] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.586868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1189.587189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.050164] env[69728]: INFO networking_nsxv3.common.synchronization [req-d566cbeb-94a0-48e7-9599-b843d164d7e8 req-7c38145e-a77f-4e14-adc5-cc84ab3b0170 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1190.050732] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1190.051050] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.051173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.051238] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.051440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.052204] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.052204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.052204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.052204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.052204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.052204] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.069254] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.069397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.074916] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.078754] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ba79e78-f60a-4886-a4e5-49e92151d3ea with status ACTIVE [ 1190.078754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.078754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.078754] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.078754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.078754] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ba79e78-f60a-4886-a4e5-49e92151d3ea is going to be updated. [ 1190.079568] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.079688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.079754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.080026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.080026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.080122] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1190.105530] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.105722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.105757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.106052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.106105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.106298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ba79e78-f60a-4886-a4e5-49e92151d3ea" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.125782] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.125782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.126051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.126118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.126358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.138372] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1190.436919] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.436919] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.437113] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.437364] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.437676] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.437910] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.438098] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.438489] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.438606] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.438805] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.438968] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.439071] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.439177] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.439306] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.439419] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.439566] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.457008] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.457236] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.457348] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.457560] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.457896] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-1270397c-d0d3-4cc2-953a-ce4ab9a12557 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.458365] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.458365] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.458576] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.458743] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1270397c-d0d3-4cc2-953a-ce4ab9a12557',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.554562] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.554734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.554807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.555037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.555136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.555333] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.555447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.555529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.555691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.555797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.555918] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1190.575905] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.581975] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.581975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.581975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.581975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.581975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.590302] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1190.961587] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.961862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.961998] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.962326] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.962514] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.962684] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 1270397c-d0d3-4cc2-953a-ce4ab9a12557 not found, creating... [ 1190.962959] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.963141] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.963266] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.963495] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.963639] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.963930] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.964106] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.964227] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.964464] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.964614] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.964756] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 1270397c-d0d3-4cc2-953a-ce4ab9a12557 is going to be created. [ 1191.084688] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.084688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.084688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.084688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.084884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.084884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 is going to be created. [ 1191.104163] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.104442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.104600] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.104929] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.105189] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.105439] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.139151] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.139348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.139348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.139559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.139713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.163556] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 in Status: UNINITIALIZED for 2s [ 1191.804059] env[69728]: INFO networking_nsxv3.common.synchronization [req-d566cbeb-94a0-48e7-9599-b843d164d7e8 req-165c3021-25b3-453c-96ca-2b46ef38c1fe service nova] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 1191.804059] env[69728]: INFO networking_nsxv3.common.synchronization [req-d566cbeb-94a0-48e7-9599-b843d164d7e8 req-165c3021-25b3-453c-96ca-2b46ef38c1fe service nova] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1191.804059] env[69728]: INFO networking_nsxv3.common.synchronization [req-d566cbeb-94a0-48e7-9599-b843d164d7e8 req-165c3021-25b3-453c-96ca-2b46ef38c1fe service nova] Enqueued Resource ID: 1270397c-d0d3-4cc2-953a-ce4ab9a12557 with Priority: HIGHEST for action port [ 1191.804059] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 1191.804059] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1191.804059] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1270397c-d0d3-4cc2-953a-ce4ab9a12557 with Priority: HIGHEST for action port [ 1191.804059] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.804059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.804059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.804059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.804059] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.804899] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.804899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.804979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-1270397c-d0d3-4cc2-953a-ce4ab9a12557 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.805421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.805421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.805421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.805605] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1270397c-d0d3-4cc2-953a-ce4ab9a12557',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.151445] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 4s [ 1192.307286] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.307431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.311296] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1270397c-d0d3-4cc2-953a-ce4ab9a12557 with status ACTIVE [ 1192.312063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.312259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.312300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.312764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.312764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.312891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.312941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.312973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.313150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.313226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.313412] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.313520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.313782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.313782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.313782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.313957] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1270397c-d0d3-4cc2-953a-ce4ab9a12557 is going to be updated. [ 1192.333674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.333835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.333892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.334101] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.334243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.334403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1270397c-d0d3-4cc2-953a-ce4ab9a12557" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.599512] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1192.600091] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf deletion is rescheduled due to dependency. [ 1192.600091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.600091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.600408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.600408] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.600622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.600622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.600758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.600802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.600901] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.103188] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.172235] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 in Status: SUCCESS [ 1193.172876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.172876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.172876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.173057] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.173319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.173319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.173458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.173458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.173536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.173668] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.606604] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.676206] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.676738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.676738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.676872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.676994] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.677134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.677205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.677374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.677465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.677562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.677734] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.677800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.677845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.677977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.678130] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.678223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.678286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.678472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.678596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.678725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.679108] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.109880] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.110275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.110275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.110275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.110472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.110472] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1194.135680] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.135871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.135928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.136137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.136296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.147080] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1194.165600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1194.165600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.165600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.165600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.166189] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.166189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.166189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.166354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.166446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.166650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.166650] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.184909] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bac7c5b8-0d93-4c24-85a1-a5abbc41b120: rpc.has_security_group_logging(os_id): False [ 1194.203320] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.203483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.203566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.203788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.203874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.204114] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.204242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.204353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.204549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.204678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.204901] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.204985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.205879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.205879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.205879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.205879] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.205879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.205879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.206355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.206355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.206355] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 is going to be created. [ 1194.260324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.260512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.260586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.260826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.261060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.264870] env[69728]: INFO networking_nsxv3.common.synchronization [req-44ff083c-dde9-4dc0-80be-82d0bcbe3b43 req-5caa90a4-0ad2-4641-8a97-0f69c82d9628 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1194.265509] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1194.266312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.266462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.266531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.266730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.266875] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.266987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.267130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.267242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.267354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.267473] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.276159] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 in Status: IN_PROGRESS for 2s [ 1194.676582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.676582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.676582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.676582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.676582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.677421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.677421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.677421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.677421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.677421] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.697148] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.697148] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.697148] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.697148] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.699708] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.699708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.699708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.699708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.699708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.699884] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.700034] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.700087] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.700530] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.700530] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.700530] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.700694] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.718559] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.720196] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.720196] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.720196] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.720196] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-54139ea7-7b3b-4e12-8d85-303217804f72 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.720196] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.720196] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.720196] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.720531] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54139ea7-7b3b-4e12-8d85-303217804f72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.770309] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.770485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.773385] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.773385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.773385] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1194.797644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.798507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.798507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.798818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.798981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.810472] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1195.109972] env[69728]: INFO networking_nsxv3.common.synchronization [req-a08926b4-b37a-42e6-a0c0-7feeeb6c011f req-4626fd69-b6b3-48f3-b131-a8feb795f188 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1195.110517] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1195.110830] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.110952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.111213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.111463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.111652] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.111796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.111882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.112078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.112198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.112377] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.180382] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00587369-d416-4d4c-b7d8-d80624c5056b: rpc.has_security_group_logging(os_id): False [ 1195.198224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.198367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.198443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.198650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.198743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.199025] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.199090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.199123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.199271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.199351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.199529] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.199636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.199690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.199849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.199928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.200133] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.200227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.200288] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.200429] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.200507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.200592] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1195.225692] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.225936] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.226084] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.226395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.226559] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.226719] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 54139ea7-7b3b-4e12-8d85-303217804f72 not found, creating... [ 1195.227572] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.227572] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.227572] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.227572] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.227778] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.228684] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.228984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.229198] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.229494] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.229882] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.230104] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 54139ea7-7b3b-4e12-8d85-303217804f72 is going to be created. [ 1195.262590] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.262713] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.262857] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.263226] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.263521] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.263817] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.302124] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.302479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.302479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.302623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.302790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.321702] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1195.615705] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.982634] env[69728]: INFO networking_nsxv3.common.synchronization [req-44ff083c-dde9-4dc0-80be-82d0bcbe3b43 req-9958be9b-8086-4af0-8f70-3b322af7826c service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 1195.982634] env[69728]: INFO networking_nsxv3.common.synchronization [req-44ff083c-dde9-4dc0-80be-82d0bcbe3b43 req-9958be9b-8086-4af0-8f70-3b322af7826c service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1195.983062] env[69728]: INFO networking_nsxv3.common.synchronization [req-44ff083c-dde9-4dc0-80be-82d0bcbe3b43 req-9958be9b-8086-4af0-8f70-3b322af7826c service nova] Enqueued Resource ID: 54139ea7-7b3b-4e12-8d85-303217804f72 with Priority: HIGHEST for action port [ 1195.984250] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 1195.984394] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1195.984583] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54139ea7-7b3b-4e12-8d85-303217804f72 with Priority: HIGHEST for action port [ 1195.984952] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.985049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.985133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.985262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.985341] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.986891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.986992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.987221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-54139ea7-7b3b-4e12-8d85-303217804f72 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.987329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.987393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.987566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.987639] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54139ea7-7b3b-4e12-8d85-303217804f72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.121771] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.156197] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1196.156395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.156517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.156800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.157097] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.157241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.157312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.157510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.157638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.157735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.157825] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.288550] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 in Status: SUCCESS [ 1196.289110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.490022] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.490199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.490324] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54139ea7-7b3b-4e12-8d85-303217804f72 with status ACTIVE [ 1196.490494] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.490596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.490658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.491592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.491592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.491592] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.491592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.491592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.491592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.491592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.491856] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.491856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.491856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.491951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.492624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.492624] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54139ea7-7b3b-4e12-8d85-303217804f72 is going to be updated. [ 1196.513674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.514010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.514100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.514635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.514635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.514635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.625373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.625373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.625475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.625691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.625961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.625961] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1196.660366] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.662527] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.662685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.662733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.662941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.665209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.673580] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1196.821453] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1196.821453] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 deletion is rescheduled due to dependency. [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.821453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.821453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.821453] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.167337] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fb31477-cec0-4034-8f2e-e510893e6ddf: rpc.has_security_group_logging(os_id): False [ 1197.187644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.187644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.187644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.187857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.187857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.188619] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.188787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.188874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.189068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.189191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.189245] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1197.247673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.250203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.250416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.250738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.251013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.268368] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1197.325226] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.339851] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1197.340181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.826591] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.330107] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.330969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.330969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.330969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.330969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.330969] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1198.357360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.357480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.357480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.357918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.357918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.368424] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1198.436502] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e8d86398-7b77-4705-bee1-9ac52999c89a None None] Enqueued Resource ID: ac2fcc7c-9306-44c6-8da4-24dd2759acef with Priority: HIGHEST for action port [ 1198.437108] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac2fcc7c-9306-44c6-8da4-24dd2759acef with Priority: HIGHEST for action port [ 1198.437437] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac2fcc7c-9306-44c6-8da4-24dd2759acef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.437564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac2fcc7c-9306-44c6-8da4-24dd2759acef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.437633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac2fcc7c-9306-44c6-8da4-24dd2759acef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.437893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac2fcc7c-9306-44c6-8da4-24dd2759acef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.437982] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac2fcc7c-9306-44c6-8da4-24dd2759acef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.682717] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1198.683063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.700111] env[69728]: INFO networking_nsxv3.common.synchronization [req-926a8702-9487-49d9-b1d8-0dba06ffd62e req-d11e385a-5d74-49b4-8aa7-91ca4b054252 tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1198.701130] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1198.701130] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.701130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.702347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.702574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.702737] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.702838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.702902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.703067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.703153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.703248] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.940028] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac2fcc7c-9306-44c6-8da4-24dd2759acef [ 1198.940255] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.940394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.940463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.940750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.940860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.940948] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac2fcc7c-9306-44c6-8da4-24dd2759acef already deleted. [ 1198.941043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac2fcc7c-9306-44c6-8da4-24dd2759acef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.209023] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.232818] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.233023] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.233188] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.233737] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.233821] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.233965] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.235975] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.236252] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.239023] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.239023] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1199.239023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.239023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.239023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.239023] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1199.239023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.239023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.259234] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.259416] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1199.259564] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.259750] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-108" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.260681] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-96463bc4-dcfd-4fff-a561-e6a858a390e6 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.260681] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.260681] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.260993] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.260993] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96463bc4-dcfd-4fff-a561-e6a858a390e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.280346] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1199.280637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.712666] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.763263] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.763536] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.763672] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.763958] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.764132] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.764324] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 96463bc4-dcfd-4fff-a561-e6a858a390e6 not found, creating... [ 1199.764685] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.764921] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.765235] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.765488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.765686] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.766066] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.766276] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.766442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.766694] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.766911] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.767167] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 96463bc4-dcfd-4fff-a561-e6a858a390e6 is going to be created. [ 1199.789021] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.789273] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.789416] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.789718] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.789965] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.790336] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.215232] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.215395] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.215873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.215873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.215964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.216061] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 1200.248555] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.248730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.248807] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.249107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.249225] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.257931] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 1200.372332] env[69728]: INFO networking_nsxv3.common.synchronization [None req-187d1569-2d8e-42c6-ab3e-edc34910102d None None] Enqueued Resource ID: 8614125d-b014-4125-b700-5c52714e7fb3 with Priority: HIGHEST for action port [ 1200.373279] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8614125d-b014-4125-b700-5c52714e7fb3 with Priority: HIGHEST for action port [ 1200.373594] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-8614125d-b014-4125-b700-5c52714e7fb3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.373720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8614125d-b014-4125-b700-5c52714e7fb3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.373778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8614125d-b014-4125-b700-5c52714e7fb3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.374383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8614125d-b014-4125-b700-5c52714e7fb3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.374383] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8614125d-b014-4125-b700-5c52714e7fb3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.380025] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1200.380240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.380397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.380592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.380774] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.380885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.380952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.381119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.381209] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.381299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.381390] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.520767] env[69728]: INFO networking_nsxv3.common.synchronization [req-926a8702-9487-49d9-b1d8-0dba06ffd62e req-870d5d5c-fce6-48f7-9e6d-6b4b8a486259 service nova] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 1200.520943] env[69728]: INFO networking_nsxv3.common.synchronization [req-926a8702-9487-49d9-b1d8-0dba06ffd62e req-870d5d5c-fce6-48f7-9e6d-6b4b8a486259 service nova] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1200.521117] env[69728]: INFO networking_nsxv3.common.synchronization [req-926a8702-9487-49d9-b1d8-0dba06ffd62e req-870d5d5c-fce6-48f7-9e6d-6b4b8a486259 service nova] Enqueued Resource ID: 96463bc4-dcfd-4fff-a561-e6a858a390e6 with Priority: HIGHEST for action port [ 1200.521794] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_rules [ 1200.523021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1200.523021] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96463bc4-dcfd-4fff-a561-e6a858a390e6 with Priority: HIGHEST for action port [ 1200.523021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.523021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.523021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.523021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.523021] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.524657] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.524746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.525767] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-96463bc4-dcfd-4fff-a561-e6a858a390e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.525767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.525767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.525767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.525767] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96463bc4-dcfd-4fff-a561-e6a858a390e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.826452] env[69728]: INFO networking_nsxv3.common.synchronization [req-ab814d0f-f72e-4d52-9669-b0cf3a6614a2 req-874a8e53-4a25-439c-96c2-2e6bc41e752b tempest-ServersNegativeTestMultiTenantJSON-1319440590 tempest-ServersNegativeTestMultiTenantJSON-1319440590-project-member] Enqueued Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_members [ 1200.827367] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGHEST for action security_group_members [ 1200.827930] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.828093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.828165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.828806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.828806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.828961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.828961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.829274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.829603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.829603] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.876868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8614125d-b014-4125-b700-5c52714e7fb3 [ 1200.878436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.878436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.878436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.878436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.878436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.878436] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8614125d-b014-4125-b700-5c52714e7fb3 already deleted. [ 1200.878436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8614125d-b014-4125-b700-5c52714e7fb3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.884397] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.027028] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.027218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.027446] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96463bc4-dcfd-4fff-a561-e6a858a390e6 with status ACTIVE [ 1201.027627] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.027765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.027794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.027991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.028098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.028359] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.028611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.028611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.028746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.028746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.028912] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.029056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.029095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.029216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.029291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.029378] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96463bc4-dcfd-4fff-a561-e6a858a390e6 is going to be updated. [ 1201.061593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.061736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.061810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.062049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.062193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.062377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96463bc4-dcfd-4fff-a561-e6a858a390e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.333845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.333845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.333845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.333845] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 is going to be updated. [ 1201.359050] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.359232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.359289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.359715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.359862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.367913] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 in Status: IN_PROGRESS for 2s [ 1201.387372] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562643dd-522c-4927-b2ad-26c57a85d1e3: rpc.has_security_group_logging(os_id): False [ 1201.403777] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.403928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.404159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.404239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.404327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.404563] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.404742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.404742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.404858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.404937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.405033] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1201.468398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.468583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.468682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.469363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.469363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.483739] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1202.269322] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 1202.270838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.270838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.270838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.271542] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.271542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.271542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.271733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.271770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.272156] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.581819] env[69728]: INFO networking_nsxv3.common.synchronization [None req-c703913e-1166-4241-b5c4-19f97574e485 None None] Enqueued Resource ID: 765825ef-408e-476e-a84d-aac9fb276de8 with Priority: HIGHEST for action port [ 1202.582390] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 765825ef-408e-476e-a84d-aac9fb276de8 with Priority: HIGHEST for action port [ 1202.582744] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-765825ef-408e-476e-a84d-aac9fb276de8 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.582873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-765825ef-408e-476e-a84d-aac9fb276de8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.583053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-765825ef-408e-476e-a84d-aac9fb276de8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.583599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-765825ef-408e-476e-a84d-aac9fb276de8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.583674] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('765825ef-408e-476e-a84d-aac9fb276de8',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.774957] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.086838] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 765825ef-408e-476e-a84d-aac9fb276de8 [ 1203.086838] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.086838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.086838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.086838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.086838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.086838] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:765825ef-408e-476e-a84d-aac9fb276de8 already deleted. [ 1203.086838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-765825ef-408e-476e-a84d-aac9fb276de8" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.281566] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.377027] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 in Status: SUCCESS [ 1203.377027] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 deletion is rescheduled due to dependency. [ 1203.377027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.500548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1203.500548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.782605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.782891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.782891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.783261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.783261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.783261] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 1203.809996] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.810163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.810233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.810444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.810586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.820447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 1204.890062] env[69728]: INFO networking_nsxv3.common.synchronization [None req-66212295-8bfe-4da2-9999-d19b04b09de0 None None] Enqueued Resource ID: ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9 with Priority: HIGHEST for action port [ 1204.890062] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9 with Priority: HIGHEST for action port [ 1204.890062] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.890062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.890062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.890062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.890062] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.978795] env[69728]: INFO networking_nsxv3.common.synchronization [req-91432a83-d1d5-44d1-b9f6-070c28b68043 req-93feab9b-6497-45aa-b6e0-6802f3e08bbe tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1204.979321] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1204.979458] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.979655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.979766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.979918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.980141] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.980246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.980309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.980461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.980547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.980642] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.398922] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9 [ 1205.399325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.399527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.399653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.399975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.400147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.400305] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9 already deleted. [ 1205.400453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae8246cc-ee7f-45aa-bdc2-7bee2802f8a9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.483785] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.625210] env[69728]: INFO networking_nsxv3.common.synchronization [req-c020357f-07eb-4943-8673-be574090cf7f req-ea9e442a-bed3-42cb-8377-1722c0e7a5de tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1205.625743] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1205.626112] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.626245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.626308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.626520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.626671] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.626763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.626856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.627014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.627109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.627201] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.831188] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 1205.831188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.831188] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.831424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.831508] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.831627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.831697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.831845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.831929] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.832042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.832317] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.986386] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.131332] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.131471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.131539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.131756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.131838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.132520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.132520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.132520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.132520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.132520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.132520] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1206.164556] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.164714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.164806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.165214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.165214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.174616] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1206.334508] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.489277] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.489453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.489533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.489739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.489834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.490214] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be updated. [ 1206.518194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.518743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.518826] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.519078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.519235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.527599] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1206.836724] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dafae610-4861-4852-9c85-d723484b91f0: rpc.has_security_group_logging(os_id): False [ 1206.857354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.857354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.857354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.857354] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 1206.913317] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.913317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.913317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.913317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.913317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.926131] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 1206.933369] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-71ddd3cb-9ac3-4c5a-a768-e8b5fa186661 tempest-ListServersNegativeTestJSON-2023222538 tempest-ListServersNegativeTestJSON-2023222538-project-member] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1206.933369] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1206.933369] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.933369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.933369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.933369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.934861] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.934861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.934861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.934861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.934861] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.934861] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.386970] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.387361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.387361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.387661] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.387932] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.388285] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.388480] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.388653] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.388800] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.389029] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.389151] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.389262] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.389373] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.389486] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1207.389595] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.389731] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.408091] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.408296] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1207.408396] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.408730] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.409061] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.409244] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.409370] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.409675] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.409817] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.436684] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.437115] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.437217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.437507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.437665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.437990] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.438165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.438276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.438591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.438662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.438795] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 already deleted. [ 1207.438932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.912671] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.912903] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.913051] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.913345] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.913495] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.913654] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 not found, creating... [ 1207.913919] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.914095] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.914216] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.914437] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.914603] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.914927] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.915056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.915181] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.915393] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.915557] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.915706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 is going to be created. [ 1207.936029] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.936029] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.936029] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.936029] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.936029] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.936029] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.184533] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1208.184533] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1208.184713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.540109] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1208.540364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.673299] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-eb1bba79-9f4a-4afa-b6bc-457b7d3f9ff9 service nova] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_rules [ 1208.673490] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-eb1bba79-9f4a-4afa-b6bc-457b7d3f9ff9 service nova] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1208.673635] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-eb1bba79-9f4a-4afa-b6bc-457b7d3f9ff9 service nova] Enqueued Resource ID: 6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 with Priority: HIGHEST for action port [ 1208.673875] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_rules [ 1208.674008] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1208.674139] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 with Priority: HIGHEST for action port [ 1208.674782] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.674863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.674955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.675490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.675775] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.677531] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.677651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.677719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.677903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.678068] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.678169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.678232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.678381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.678467] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.678567] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.679314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.679461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.679513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.679626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.679702] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.939355] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 1208.939627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.184947] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.186074] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.186193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.186356] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 with status ACTIVE [ 1209.186552] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.186782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.186782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.187018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.188365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.188950] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.189180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.189333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.189564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.189662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.189979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.190193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.190308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.190902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.190902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.190902] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3 is going to be updated. [ 1209.196522] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-b6e37d40-cc78-415a-b149-399886c6f7ea tempest-ListServersNegativeTestJSON-2023222538 tempest-ListServersNegativeTestJSON-2023222538-project-member] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1209.197477] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1209.199101] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.199255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.216881] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.217277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.217277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.217444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.217603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.217819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a3d7562-1f1e-40f9-afa9-6f8133a9d6d3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.475291] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.475554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.475664] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.476071] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.476326] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.476488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.476765] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.477444] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.477671] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.478116] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.478261] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.478472] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.478726] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.478894] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.479025] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.479162] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.505766] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.505930] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.506130] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.506672] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.507666] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.507949] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.508074] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.508416] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.508569] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ce3afd-df85-4bf4-a49b-718fc28b2d7b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.699444] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.014025] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.014025] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port a7ce3afd-df85-4bf4-a49b-718fc28b2d7b not found, creating... [ 1210.014025] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.014025] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.015641] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.016166] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.016588] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.017121] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.017552] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.017975] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: a7ce3afd-df85-4bf4-a49b-718fc28b2d7b is going to be created. [ 1210.040062] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.040062] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.040062] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.040062] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.040062] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.041464] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.204022] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.204022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.204022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.204022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.204022] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.204022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be created. [ 1210.230122] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.230254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.230335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.230595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.230789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.239774] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: UNINITIALIZED for 2s [ 1210.823417] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-8eb4c365-0279-4170-af99-a63ee55057c6 service nova] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_rules [ 1210.823713] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-8eb4c365-0279-4170-af99-a63ee55057c6 service nova] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1210.824935] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-8eb4c365-0279-4170-af99-a63ee55057c6 service nova] Enqueued Resource ID: a7ce3afd-df85-4bf4-a49b-718fc28b2d7b with Priority: HIGHEST for action port [ 1210.824935] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_rules [ 1210.824935] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1210.824935] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ce3afd-df85-4bf4-a49b-718fc28b2d7b with Priority: HIGHEST for action port [ 1210.825404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.825404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.825649] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.825782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.826039] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.826199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.826303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.826587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.826705] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ce3afd-df85-4bf4-a49b-718fc28b2d7b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.328887] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7ce3afd-df85-4bf4-a49b-718fc28b2d7b with status ACTIVE [ 1211.329225] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.329403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.329510] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.329794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.329917] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.330184] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.330319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.330407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.330765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.330765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.330964] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.331109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.331195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.331388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.331491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.331664] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7ce3afd-df85-4bf4-a49b-718fc28b2d7b is going to be updated. [ 1211.354118] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.354319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.354319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.354496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.354668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.355301] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ce3afd-df85-4bf4-a49b-718fc28b2d7b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.526206] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-2241f449-b31e-4291-b430-f7e1ad96dc35 tempest-ListServersNegativeTestJSON-2023222538 tempest-ListServersNegativeTestJSON-2023222538-project-member] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1211.526729] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1211.527046] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.527153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.942325] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-576 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.942700] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.942743] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.942990] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.943275] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.943439] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.943562] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.943784] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.943936] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.944415] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.944583] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1211.944759] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1211.944876] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1211.944995] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1211.945120] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1211.945256] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1211.963539] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1211.963719] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1211.963841] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1211.964041] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-576" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.964361] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-16e9e068-c9b8-4220-acfa-cb784e0d009e taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.964564] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.964692] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.965041] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.965193] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e9e068-c9b8-4220-acfa-cb784e0d009e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.250208] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1212.250939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.251044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.251613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.251613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.251763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.251871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.252132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.252261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.252399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.252671] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.253591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.254753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.254753] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.254753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.254753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.255291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.255291] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.255291] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.468098] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.468366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.468501] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.468785] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.468942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.469135] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 16e9e068-c9b8-4220-acfa-cb784e0d009e not found, creating... [ 1212.469424] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.469601] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.469732] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.470018] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.470198] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.470530] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.470700] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.470845] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.471167] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.471316] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.471499] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 16e9e068-c9b8-4220-acfa-cb784e0d009e is going to be created. [ 1212.493491] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.493748] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.493892] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.494219] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.494458] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.494914] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.757113] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.757203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.757328] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.259617] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.264850] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-3e823377-9dfe-4550-a0b9-5fe3cb206666 service nova] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_rules [ 1213.264962] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-3e823377-9dfe-4550-a0b9-5fe3cb206666 service nova] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1213.265119] env[69728]: INFO networking_nsxv3.common.synchronization [req-9e7c47e9-30cb-461a-88fa-c9b558b9f256 req-3e823377-9dfe-4550-a0b9-5fe3cb206666 service nova] Enqueued Resource ID: 16e9e068-c9b8-4220-acfa-cb784e0d009e with Priority: HIGHEST for action port [ 1213.265335] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_rules [ 1213.265454] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1213.265554] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e9e068-c9b8-4220-acfa-cb784e0d009e with Priority: HIGHEST for action port [ 1213.266484] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.266585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.266692] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.266770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.266988] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e9e068-c9b8-4220-acfa-cb784e0d009e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.267119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.267179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.267354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.267428] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e9e068-c9b8-4220-acfa-cb784e0d009e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.762070] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.762256] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.762330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.762649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.762746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.762866] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1213.769734] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16e9e068-c9b8-4220-acfa-cb784e0d009e with status ACTIVE [ 1213.769945] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.770086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.770156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.770351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.770440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.770620] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.770722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.770785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.770932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.771016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.771228] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.771325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.771385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.771528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.771605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.771689] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16e9e068-c9b8-4220-acfa-cb784e0d009e is going to be updated. [ 1213.796268] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.796268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.796268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.796268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.796268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.796268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e9e068-c9b8-4220-acfa-cb784e0d009e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.804211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.804211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.804211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.804211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.804211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.810170] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1215.825032] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1215.825460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.825460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.825596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.825710] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.825878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.825958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.826822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.826822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.826822] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.329086] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.338464] env[69728]: INFO networking_nsxv3.common.synchronization [req-55be795f-fdd8-40cd-88ae-0b18c09f1b0d req-a8efb2f0-4cd3-410a-96a5-c90eb35af1de tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1216.338742] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1216.343804] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.343804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.343804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.343804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.344144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.344144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.344144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.349247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.349247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.349247] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.705292] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.706104] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.706296] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.706606] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.706912] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.707111] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.707238] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.707464] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.707616] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.707829] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.707948] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.708074] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.708188] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.708301] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.708413] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.708548] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.730567] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.730816] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.730995] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.731218] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.731563] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-206418f5-4bfe-4852-ad24-12a71a0b32cb taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.731778] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.731911] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.732233] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.732373] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('206418f5-4bfe-4852-ad24-12a71a0b32cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.831425] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.851264] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.235666] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.235928] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.236076] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.236397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.236556] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.236723] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 206418f5-4bfe-4852-ad24-12a71a0b32cb not found, creating... [ 1217.237011] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.237207] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.237330] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.237555] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.237695] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.238057] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.238191] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.238321] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.238539] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.238678] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.238824] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 206418f5-4bfe-4852-ad24-12a71a0b32cb is going to be created. [ 1217.257455] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.257673] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.257803] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.258074] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.258304] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.258529] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.333390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.333557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.333632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.333864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.333958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.334081] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1217.352988] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.387559] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.387760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.387862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.388277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.388277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.398965] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1217.858071] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.858444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.858444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.858519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.859135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.859135] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1217.889432] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.889432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.889593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.889735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.889898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.899191] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1218.240392] env[69728]: INFO networking_nsxv3.common.synchronization [req-55be795f-fdd8-40cd-88ae-0b18c09f1b0d req-757278a9-835e-4cdc-92d8-506544f4bcf6 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1218.240601] env[69728]: INFO networking_nsxv3.common.synchronization [req-55be795f-fdd8-40cd-88ae-0b18c09f1b0d req-757278a9-835e-4cdc-92d8-506544f4bcf6 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1218.240743] env[69728]: INFO networking_nsxv3.common.synchronization [req-55be795f-fdd8-40cd-88ae-0b18c09f1b0d req-757278a9-835e-4cdc-92d8-506544f4bcf6 service nova] Enqueued Resource ID: 206418f5-4bfe-4852-ad24-12a71a0b32cb with Priority: HIGHEST for action port [ 1218.241300] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1218.241438] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1218.241538] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 206418f5-4bfe-4852-ad24-12a71a0b32cb with Priority: HIGHEST for action port [ 1218.241821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.241946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.245221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.246345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.246345] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.246624] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.246624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.247130] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-206418f5-4bfe-4852-ad24-12a71a0b32cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.247130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.247130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.247130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.247334] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('206418f5-4bfe-4852-ad24-12a71a0b32cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.464494] env[69728]: INFO networking_nsxv3.common.synchronization [req-cfb0e930-aa0f-4596-b438-f267e8b6018a req-600045b1-16ff-4d97-871e-06c0309bd418 tempest-InstanceActionsTestJSON-265267644 tempest-InstanceActionsTestJSON-265267644-project-member] Enqueued Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_members [ 1218.465073] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_members [ 1218.465397] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.465520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.465587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.465865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.471194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.471403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.471479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.471708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.471806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.472015] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.748690] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.748828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.749547] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 206418f5-4bfe-4852-ad24-12a71a0b32cb with status ACTIVE [ 1218.749547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.749547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.749547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.749547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.749754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.749921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.749921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.750056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.750098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.750234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.750354] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.750460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.750566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.750673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.750749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.750833] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 206418f5-4bfe-4852-ad24-12a71a0b32cb is going to be updated. [ 1218.774090] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.774376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.774376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.775027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.775027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.775027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-206418f5-4bfe-4852-ad24-12a71a0b32cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.977851] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.978388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.978388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.978388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.978388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.978625] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.978737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.978737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.982161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.982161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.982161] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef already deleted. [ 1218.982161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.070941] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.071162] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-533" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.071291] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-533" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.071611] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-533" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.071864] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.076295] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.076497] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.076784] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.077008] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.077318] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.077447] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.077562] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.077671] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.077770] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1219.077881] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.078219] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.098068] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.098242] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1219.098381] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.098879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-533" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.098879] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-1c09bebd-8452-4165-b9c5-faf22091a534 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.099087] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.099231] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.099467] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.099613] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c09bebd-8452-4165-b9c5-faf22091a534',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.113370] env[69728]: INFO networking_nsxv3.common.synchronization [None req-d143a6e2-f10d-457e-80a5-593f1679e242 None None] Enqueued Resource ID: 20b28f33-bdd7-4b3a-8730-7c68b686a74b with Priority: HIGHEST for action port [ 1219.113651] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20b28f33-bdd7-4b3a-8730-7c68b686a74b with Priority: HIGHEST for action port [ 1219.114168] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-20b28f33-bdd7-4b3a-8730-7c68b686a74b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.114264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20b28f33-bdd7-4b3a-8730-7c68b686a74b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.114327] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20b28f33-bdd7-4b3a-8730-7c68b686a74b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.114621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20b28f33-bdd7-4b3a-8730-7c68b686a74b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.114679] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20b28f33-bdd7-4b3a-8730-7c68b686a74b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.422142] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.422142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.422142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.422142] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.602467] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.606024] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 1c09bebd-8452-4165-b9c5-faf22091a534 not found, creating... [ 1219.606024] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.606024] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.606498] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.606498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.606498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.606498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.606498] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.606992] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 1c09bebd-8452-4165-b9c5-faf22091a534 is going to be created. [ 1219.619160] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20b28f33-bdd7-4b3a-8730-7c68b686a74b [ 1219.619533] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.619832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.620614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.620614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.620614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.620614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20b28f33-bdd7-4b3a-8730-7c68b686a74b already deleted. [ 1219.620614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20b28f33-bdd7-4b3a-8730-7c68b686a74b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.627989] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.628833] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.631044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.631044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.631044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.631044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.914298] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.914298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.914298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.914298] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.924514] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.417135] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.427474] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.527621] env[69728]: INFO networking_nsxv3.common.synchronization [req-cfb0e930-aa0f-4596-b438-f267e8b6018a req-688b0e05-f2b2-4df5-a737-791053f6278b service nova] Enqueued Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_rules [ 1220.527819] env[69728]: INFO networking_nsxv3.common.synchronization [req-cfb0e930-aa0f-4596-b438-f267e8b6018a req-688b0e05-f2b2-4df5-a737-791053f6278b service nova] Enqueued Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_members [ 1220.527972] env[69728]: INFO networking_nsxv3.common.synchronization [req-cfb0e930-aa0f-4596-b438-f267e8b6018a req-688b0e05-f2b2-4df5-a737-791053f6278b service nova] Enqueued Resource ID: 1c09bebd-8452-4165-b9c5-faf22091a534 with Priority: HIGHEST for action port [ 1220.528234] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_rules [ 1220.528363] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_members [ 1220.528460] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c09bebd-8452-4165-b9c5-faf22091a534 with Priority: HIGHEST for action port [ 1220.533102] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.533296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.533393] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.533723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.533838] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.535465] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.535465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.535465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.535639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.535831] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.535955] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.536054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.536200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.536287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.536379] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.537663] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c09bebd-8452-4165-b9c5-faf22091a534 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.537663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.537663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.537663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.537663] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c09bebd-8452-4165-b9c5-faf22091a534',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.732832] env[69728]: INFO networking_nsxv3.common.synchronization [None req-64cabb3e-ff9f-4fd1-a98a-942900684636 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1220.733383] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1220.733686] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.733810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.733878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.734245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.734245] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.827461] env[69728]: INFO networking_nsxv3.common.synchronization [None req-e10c0a4b-c126-44dd-b06c-e2dfb5901673 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1220.827749] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1220.828048] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.828150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.922806] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.929634] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.929979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.930337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.930758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.930946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.932675] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1220.959420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.959420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.959420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.959420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.959420] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.966265] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1221.043019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.043019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.043019] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c09bebd-8452-4165-b9c5-faf22091a534 with status ACTIVE [ 1221.043019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.043019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.043019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.043547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.043547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.043547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.043547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.043547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.043547] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c09bebd-8452-4165-b9c5-faf22091a534 is going to be updated. [ 1221.067180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.067180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.067180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.067180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.067180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.067180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c09bebd-8452-4165-b9c5-faf22091a534" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.118200] env[69728]: INFO networking_nsxv3.common.synchronization [None req-0cd2592a-6364-465d-9ff3-f12447f45903 None None] Enqueued Resource ID: 818ce0d4-763b-412f-95a8-92be7fdeecb4 with Priority: HIGHEST for action port [ 1221.118200] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 818ce0d4-763b-412f-95a8-92be7fdeecb4 with Priority: HIGHEST for action port [ 1221.118200] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-818ce0d4-763b-412f-95a8-92be7fdeecb4 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.118200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-818ce0d4-763b-412f-95a8-92be7fdeecb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.118200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-818ce0d4-763b-412f-95a8-92be7fdeecb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.118200] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-818ce0d4-763b-412f-95a8-92be7fdeecb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.118200] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('818ce0d4-763b-412f-95a8-92be7fdeecb4',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.261092] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.261269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.261320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.261638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.261737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.261836] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 already deleted. [ 1221.262786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.262786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.263674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.263674] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.430282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.430524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.430524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.430711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.430800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.430902] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1221.458579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.458724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.458822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.459062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.459215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.473619] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1221.548452] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.620970] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 818ce0d4-763b-412f-95a8-92be7fdeecb4 [ 1221.621223] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.621359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.621430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.621653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.621767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.621875] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:818ce0d4-763b-412f-95a8-92be7fdeecb4 already deleted. [ 1221.621969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-818ce0d4-763b-412f-95a8-92be7fdeecb4" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.783104] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.783259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.783334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.783674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.783781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.783881] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 already deleted. [ 1221.783963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.051558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.051743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.051890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.052024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.052123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.052228] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef is going to be created. [ 1222.077360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.077548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.077605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.077879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.078114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.088188] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef in Status: UNINITIALIZED for 2s [ 1222.804908] env[69728]: INFO networking_nsxv3.common.synchronization [req-e70c3ce1-6625-4020-8055-e7d2e39b1697 req-86531403-7bab-484b-bc3a-bf76876fdfb2 tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1222.805477] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGHEST for action security_group_members [ 1222.805881] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.805967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.805967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.808812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.810922] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.810922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.810922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.810922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.810922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.810922] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.981211] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.981211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.981211] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.981211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.982112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.982411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.982799] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.983065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.983232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.983472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.983648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.983820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.983995] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.985167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.986032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.986416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.986618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.986772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.987012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.988549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.988549] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.312453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.312648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.312723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.312936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.313041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.313242] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.313340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.313404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.316476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.316476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.316476] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be updated. [ 1223.338399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.338564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.338933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.339214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.339364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.346567] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: IN_PROGRESS for 2s [ 1223.482143] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1223.482437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.482655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.483105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.483140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.483262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.483321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.483673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.483673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.483735] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.483856] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.491403] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f54ce0c-aa48-4762-b91f-bbd54dc523d9: rpc.has_security_group_logging(os_id): False [ 1223.493019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.508212] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.508356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.508482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.508630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.508722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.508924] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.509033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.509094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.509422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.509422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.509519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.510345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.510345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.510345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.510345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.511927] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.511927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.511927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.511927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.511927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.511927] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be created. [ 1223.565910] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.566273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.566273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.566374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.566528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.577021] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1223.989981] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.989981] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.989981] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.989981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.990651] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.990651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.990651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.990651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.990651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.990651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.990651] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.996577] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.096978] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef in Status: SUCCESS [ 1224.097197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.097376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.097596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.097877] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.098016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.098084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.098252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.098333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.098419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.098512] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.494588] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1224.498454] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.498669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.498669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.498884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.498979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.499088] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1224.511151] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.511334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.511408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.511642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.511751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.511961] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.512073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.512140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.512329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.512718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.512718] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.512879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.512879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.512985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.513098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.513316] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.513451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.513551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.513751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.513871] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.513998] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1224.540031] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.540031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.540031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.540031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.540031] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.550163] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1224.588276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.588408] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.588457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.588672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.589020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.605928] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.605928] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.605928] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.605928] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.605928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.606623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.606623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.606623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.606623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.606623] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.606623] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1225.107503] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2cb5d7a-433b-4830-98bd-52cc5ae71fef: rpc.has_security_group_logging(os_id): False [ 1225.124467] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.124670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.124758] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.125202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.125202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.125899] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.125899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.125899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.125899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.125899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.126144] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.126198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.126236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.126390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.126783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.126783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.126910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.126910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.127157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.127324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.129026] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef is going to be created. [ 1225.228108] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.228279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.228333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.228601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.228781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.246126] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef in Status: IN_PROGRESS for 2s [ 1225.281682] env[69728]: INFO networking_nsxv3.common.synchronization [req-5c203a03-c7b2-4da2-be6e-c3bc215e42b2 req-951693a5-b3cc-4330-9fc5-d65d27d0ef50 tempest-ListServersNegativeTestJSON-2023222538 tempest-ListServersNegativeTestJSON-2023222538-project-member] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1225.282339] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1225.456175] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.456409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.467111] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8408d52-084d-4902-9059-c9e45aefc511 in Status: SUCCESS [ 1225.467303] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8408d52-084d-4902-9059-c9e45aefc511 deletion is rescheduled due to dependency. [ 1225.467419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.587331] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1225.587561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.588184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.588184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.588184] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.090402] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.090603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.560452] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1226.560737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.560737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.560901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.561111] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.561228] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.561353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.561444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.561525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.561619] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.616998] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1226.617239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.065400] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.257268] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef in Status: SUCCESS [ 1227.257492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.275443] env[69728]: INFO networking_nsxv3.common.synchronization [req-9a7accdc-f8f1-46e7-85f6-67a1c58b3c9b req-e09a7dcb-7a0f-4d7e-9d6c-b7ac26d12479 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1227.275998] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1227.276324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.276444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.276511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.276761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.276921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.277021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.277083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.277227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.277340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.277466] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.569675] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.586485] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.586485] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.586485] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.586710] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.586947] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.587128] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.587249] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.587472] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.587919] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.587919] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.588051] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.588051] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.588163] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.588273] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1227.588377] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.588511] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.608007] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.608196] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1227.608340] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.608511] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.608806] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-0a42a28f-6084-4ad3-af20-3e8c15c38458 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.608973] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.609105] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.609839] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.609839] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a42a28f-6084-4ad3-af20-3e8c15c38458',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.779667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.779855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.779932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.780136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.780227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.780436] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.780534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.780596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.780751] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.780828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.780913] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 already deleted. [ 1227.780991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.072509] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.072617] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.072713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.072883] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.072989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.073108] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1228.105375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.105595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.105642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.105839] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.106123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.111570] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.111777] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.111907] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.112215] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.112389] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.112563] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 0a42a28f-6084-4ad3-af20-3e8c15c38458 not found, creating... [ 1228.112863] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.113058] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.113186] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.113442] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.113607] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.113927] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.114115] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.114260] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.114501] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.114716] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.114892] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 is going to be created. [ 1228.116988] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1228.134847] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.135141] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.135357] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.135598] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.136278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.136278] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.815327] env[69728]: INFO networking_nsxv3.common.synchronization [req-9a7accdc-f8f1-46e7-85f6-67a1c58b3c9b req-8d014cef-e013-4fa1-9623-7e3f35e4b2e7 service nova] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1228.815569] env[69728]: INFO networking_nsxv3.common.synchronization [req-9a7accdc-f8f1-46e7-85f6-67a1c58b3c9b req-8d014cef-e013-4fa1-9623-7e3f35e4b2e7 service nova] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1228.815739] env[69728]: INFO networking_nsxv3.common.synchronization [req-9a7accdc-f8f1-46e7-85f6-67a1c58b3c9b req-8d014cef-e013-4fa1-9623-7e3f35e4b2e7 service nova] Enqueued Resource ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 with Priority: HIGHEST for action port [ 1228.816955] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1228.817386] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1228.818010] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 with Priority: HIGHEST for action port [ 1228.818994] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.819292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.819626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.820013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.820345] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.822224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.822224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.822224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.822740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.823545] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.823754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.824173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.824425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.824763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.825019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.826752] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a42a28f-6084-4ad3-af20-3e8c15c38458 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.827120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.827255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.827591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.828149] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a42a28f-6084-4ad3-af20-3e8c15c38458',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.865562] env[69728]: INFO networking_nsxv3.common.synchronization [None req-54084eb1-1da8-4220-b6c6-6ab61452638b tempest-AttachInterfacesTestJSON-1729150823 tempest-AttachInterfacesTestJSON-1729150823-project-member] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1228.866147] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGHEST for action security_group_members [ 1228.866519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.866655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.866896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.866959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.867268] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.867402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.867493] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.867697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.867849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.868069] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.075924] env[69728]: INFO networking_nsxv3.common.synchronization [req-0385274e-f531-41da-8abf-092757473bad req-dc155b89-8896-4db4-8c9e-0c9b53773613 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1229.076509] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1229.076841] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.076985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.077583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.077851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.081019] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.081019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.081019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.081019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.081019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.081019] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.330449] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.335526] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.335526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.335526] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a42a28f-6084-4ad3-af20-3e8c15c38458 with status ACTIVE [ 1229.336044] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.336044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.336337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.337535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.337535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.341040] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.341040] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.341040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.341040] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 is going to be updated. [ 1229.368183] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.368388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.368578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.369769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.369769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.369769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.369955] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.370142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.370254] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.370514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.370651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.370932] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.371948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.371948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.371948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.371948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.371948] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be updated. [ 1229.419496] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.419946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.420676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.421040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.421354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.479090] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: IN_PROGRESS for 2s [ 1229.582487] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.649142] env[69728]: INFO networking_nsxv3.common.synchronization [req-40649721-e736-4718-9e51-8e295bd27bf3 req-bb7dc2d4-c2f2-4b42-87c9-080671468eda tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_members [ 1229.649142] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGHEST for action security_group_members [ 1229.649142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.649142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.649142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.649142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.649142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.649828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.649971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.650230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.650407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.650780] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.843046] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.086600] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.131523] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1230.131766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.131951] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.132202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.132588] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.132769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.132769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.132985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.133070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.133119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.133204] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.157629] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.157785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.157865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.158093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.158182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.158383] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.158479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.158542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.158837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.158837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.158837] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe is going to be updated. [ 1230.202597] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.202597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.202597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.202597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.202597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.218448] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe in Status: IN_PROGRESS for 2s [ 1230.346066] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.346066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.346066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.346217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.346282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.346387] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 is going to be created. [ 1230.367974] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.368128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.368194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.368391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.368542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.376556] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: UNINITIALIZED for 2s [ 1230.588920] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.588999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.589083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.589285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.589377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.589483] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1230.617010] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.618070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.618070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.618070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.618070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.625967] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1230.636450] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.636609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.636680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.636895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.637070] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.637166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.637222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.637373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.637460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.637543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.637690] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.637800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.637859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.638008] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.638289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.638387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.638449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.638590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.638669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.638768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.638912] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.144166] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f54ce0c-aa48-4762-b91f-bbd54dc523d9: rpc.has_security_group_logging(os_id): False [ 1231.164524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.164524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.164524] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.164524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.165307] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.165307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.165307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.165307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.165307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.165307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1231.253486] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.253486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.253486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.253486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.253486] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.269425] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1231.482250] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00587369-d416-4d4c-b7d8-d80624c5056b in Status: SUCCESS [ 1231.482555] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b deletion is rescheduled due to dependency. [ 1231.482849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.050709] env[69728]: INFO networking_nsxv3.common.synchronization [req-38420c80-5543-419d-bbd8-c5c327c9ffa5 req-d07dc690-b558-4174-a407-57678817cd0d tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1232.051249] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1232.051558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.051680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.051749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.051996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.052178] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.052280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.052342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.052502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.052595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.052681] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.230443] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe in Status: SUCCESS [ 1232.230909] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe deletion is rescheduled due to dependency. [ 1232.230909] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.348342] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.348530] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.348662] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.349047] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.349325] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.350125] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.350320] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.350584] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.350744] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.350964] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.351105] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1232.351222] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1232.351332] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1232.351447] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1232.351554] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1232.351690] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1232.368884] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1232.369157] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1232.369242] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1232.369428] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.369769] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-4109a39e-4348-4b22-9c9c-3edf397834c0 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.369967] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.370035] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.370353] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.370495] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4109a39e-4348-4b22-9c9c-3edf397834c0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.384661] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: SUCCESS [ 1232.384895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.385338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.385533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.385723] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.385845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.385905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.386037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.386117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.386229] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.386326] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.554595] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.554787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.554860] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.555130] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.555240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.555448] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.555547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.555612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.555770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.555846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.555934] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1232.587386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.587525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.587593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.587787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.587936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.595553] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1232.633852] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1232.634096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.873269] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.873550] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.873667] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.874021] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.874212] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.874420] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 4109a39e-4348-4b22-9c9c-3edf397834c0 not found, creating... [ 1232.874721] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.874901] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.875044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.875303] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.875452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.875894] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.880220] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.880220] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.880411] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.880590] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.880756] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 4109a39e-4348-4b22-9c9c-3edf397834c0 is going to be created. [ 1232.889181] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.901609] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.901879] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.902035] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.902400] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.902623] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.902946] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.282586] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1233.282586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.282586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.282586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.282586] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.391367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a04243ff-dffd-4482-869c-4df47f3b1c84: rpc.has_security_group_logging(os_id): False [ 1233.412395] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.412606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.412674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.412885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.412976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.413233] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.413320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.413383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.413539] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.413608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.413690] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 is going to be created. [ 1233.471940] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.472107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.472179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.472389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.472610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.484803] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: IN_PROGRESS for 2s [ 1233.790838] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.790838] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.790838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.790838] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.791482] env[69728]: INFO networking_nsxv3.common.synchronization [req-38420c80-5543-419d-bbd8-c5c327c9ffa5 req-439bcb1f-fe79-4c8c-8749-15846fb7044b service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1233.791482] env[69728]: INFO networking_nsxv3.common.synchronization [req-38420c80-5543-419d-bbd8-c5c327c9ffa5 req-439bcb1f-fe79-4c8c-8749-15846fb7044b service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1233.791784] env[69728]: INFO networking_nsxv3.common.synchronization [req-38420c80-5543-419d-bbd8-c5c327c9ffa5 req-439bcb1f-fe79-4c8c-8749-15846fb7044b service nova] Enqueued Resource ID: 4109a39e-4348-4b22-9c9c-3edf397834c0 with Priority: HIGHEST for action port [ 1233.792370] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1233.792503] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1233.792622] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4109a39e-4348-4b22-9c9c-3edf397834c0 with Priority: HIGHEST for action port [ 1233.793668] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.793668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.793668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.793668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.793668] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.796349] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.796456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.796969] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4109a39e-4348-4b22-9c9c-3edf397834c0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.797149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.797389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.797439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.797522] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4109a39e-4348-4b22-9c9c-3edf397834c0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.297191] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.297191] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.297191] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.297191] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.297191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.297922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.297922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.297922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.297922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.297922] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.299103] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.299335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.299678] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4109a39e-4348-4b22-9c9c-3edf397834c0 with status ACTIVE [ 1234.300073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.300378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.300575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.300832] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.301349] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.301653] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.303021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.303021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.303021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.303021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.303021] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.303021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.303021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.304358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.304358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.304358] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4109a39e-4348-4b22-9c9c-3edf397834c0 is going to be updated. [ 1234.323961] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.325857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.325857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.325857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.325857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.325857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4109a39e-4348-4b22-9c9c-3edf397834c0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.359792] env[69728]: INFO networking_nsxv3.common.synchronization [None req-95e87960-e9b0-4726-bd5c-4766b130c959 None None] Enqueued Resource ID: d13e1b85-1e78-4005-9e78-30c0183be8b5 with Priority: HIGHEST for action port [ 1234.361724] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d13e1b85-1e78-4005-9e78-30c0183be8b5 with Priority: HIGHEST for action port [ 1234.362067] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-d13e1b85-1e78-4005-9e78-30c0183be8b5 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.362193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d13e1b85-1e78-4005-9e78-30c0183be8b5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.362258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d13e1b85-1e78-4005-9e78-30c0183be8b5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.362569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d13e1b85-1e78-4005-9e78-30c0183be8b5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.362637] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d13e1b85-1e78-4005-9e78-30c0183be8b5',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.605251] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1234.605426] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1234.605538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.605725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.605993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.606193] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.606312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.606379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.606533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.606619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.606708] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.806348] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f54ce0c-aa48-4762-b91f-bbd54dc523d9: rpc.has_security_group_logging(os_id): False [ 1234.826326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.826326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.826326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.826326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.827227] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.827227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.827227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.827227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.828017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.828419] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1234.866761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d13e1b85-1e78-4005-9e78-30c0183be8b5 [ 1234.866761] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.866761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.866761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.866761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.866761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.866761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d13e1b85-1e78-4005-9e78-30c0183be8b5 already deleted. [ 1234.866761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d13e1b85-1e78-4005-9e78-30c0183be8b5" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.912266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.912266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.912266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.912266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.912266] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.926436] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1235.109144] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.496468] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: SUCCESS [ 1235.496901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.614627] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.117080] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.117202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.117244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.117449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.117557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.117646] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1236.147558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.147558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.147558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.147558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.147558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.159854] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1236.537985] env[69728]: INFO networking_nsxv3.common.synchronization [req-2af5b661-1f14-4889-a483-6070022d6209 req-b67e1bd1-b8a6-47ae-adfa-09ad8dc9a540 tempest-ListServersNegativeTestJSON-2023222538 tempest-ListServersNegativeTestJSON-2023222538-project-member] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1236.538520] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1236.538827] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.538948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.539359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.539650] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.540265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.540265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.540265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.540482] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.540564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.540666] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.611462] env[69728]: INFO networking_nsxv3.common.synchronization [req-9b0d209f-2f68-49b4-b8a9-7e6083acab3a req-36eab532-b60b-458c-917b-819eaab19f8d tempest-ListServersNegativeTestJSON-2023222538 tempest-ListServersNegativeTestJSON-2023222538-project-member] Enqueued Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1236.611956] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 with Priority: HIGHEST for action security_group_members [ 1236.612281] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.612382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.711947] env[69728]: INFO networking_nsxv3.common.synchronization [None req-df16226d-3055-4864-ab9f-b80e905269cd None None] Enqueued Resource ID: c2d4b095-94ae-4616-90a6-42038a3d414a with Priority: HIGHEST for action port [ 1236.712782] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d4b095-94ae-4616-90a6-42038a3d414a with Priority: HIGHEST for action port [ 1236.712967] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2d4b095-94ae-4616-90a6-42038a3d414a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.712967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2d4b095-94ae-4616-90a6-42038a3d414a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.713230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2d4b095-94ae-4616-90a6-42038a3d414a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.713273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2d4b095-94ae-4616-90a6-42038a3d414a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.713363] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2d4b095-94ae-4616-90a6-42038a3d414a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.737036] env[69728]: INFO networking_nsxv3.common.synchronization [req-ce27d4ea-d4ae-4a6c-829c-d43400b61c07 req-1e8b4a78-0df6-46f4-82ad-b523585f83f5 tempest-InstanceActionsTestJSON-265267644 tempest-InstanceActionsTestJSON-265267644-project-member] Enqueued Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_members [ 1236.737310] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef with Priority: HIGHEST for action security_group_members [ 1236.737865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.737938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.738151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.738363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.738515] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.739052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.739052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.739052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.739052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.740296] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2cb5d7a-433b-4830-98bd-52cc5ae71fef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.941198] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1236.943060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.043979] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.216908] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2d4b095-94ae-4616-90a6-42038a3d414a [ 1237.217232] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.217380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.217380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.217566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.217645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.217738] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2d4b095-94ae-4616-90a6-42038a3d414a already deleted. [ 1237.217834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2d4b095-94ae-4616-90a6-42038a3d414a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.242755] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.242905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.242966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.243171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.243255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.243446] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.243561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.244430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.244430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.244430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.244430] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef is going to be updated. [ 1237.268906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.269098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.269185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.269363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.269562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.277312] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef in Status: IN_PROGRESS for 2s [ 1237.312030] env[69728]: INFO networking_nsxv3.common.synchronization [None req-20fca163-2c89-49c4-9d7e-1e190de9d8c0 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_rules [ 1237.312030] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_rules [ 1237.312030] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.312030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.312030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.312030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.312030] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.387136] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b3873986-e6a1-44d1-869a-1c9762e613c0 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_rules [ 1237.387629] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_rules [ 1237.387933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.388056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.546267] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.834076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.834268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.834358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.834573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.834665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.834825] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 already deleted. [ 1237.834914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.835078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.835235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.835318] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.050967] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.051270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.051379] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.051704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.051805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.052239] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1238.079034] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.079208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.079303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.079595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.079901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.088239] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1238.182659] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1238.182782] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.182926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.183190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.183410] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.183524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.183586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.183755] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.183837] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.184128] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.184128] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.356046] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.356046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.356046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.356289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.356289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.356346] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 already deleted. [ 1238.356453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.687584] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.687918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.687918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.688036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.688203] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.688305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.688371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.688523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.688663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.688696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.688841] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.688924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.688987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.689146] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.689285] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.689375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.689433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.689567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.689641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.689721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.689813] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.191882] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb: rpc.has_security_group_logging(os_id): False [ 1239.209207] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.209335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.209405] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.210007] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.210007] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.210007] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.210007] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.210353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.210353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.210353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.210541] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.210541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.210612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.210800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.210800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.210979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.211074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.211122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.211261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.211334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.211417] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1239.266337] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.266507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.266550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.266759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.266904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.279610] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1239.284889] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef in Status: SUCCESS [ 1239.284889] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2cb5d7a-433b-4830-98bd-52cc5ae71fef deletion is rescheduled due to dependency. [ 1239.284889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2cb5d7a-433b-4830-98bd-52cc5ae71fef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.033147] env[69728]: INFO networking_nsxv3.common.synchronization [req-1fa6a6bf-2f9f-410a-8d55-f0554b23a2fc req-c4986600-870a-4c52-8895-e6bd857c5b7a tempest-ServerPasswordTestJSON-1675417364 tempest-ServerPasswordTestJSON-1675417364-project-member] Enqueued Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_members [ 1240.033821] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_members [ 1240.034441] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.034601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.034691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.035014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.036449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.036571] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.036662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.037033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.037185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.037314] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.098868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1240.099173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.099377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.099679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.099916] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.100870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.100870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.100870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.100870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.100870] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f54ce0c-aa48-4762-b91f-bbd54dc523d9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.314935] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-37 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.315161] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.315289] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.315606] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.316068] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.316270] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.316588] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.316833] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.316989] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.317222] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.317337] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.317448] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.317559] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.317690] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1240.317772] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.318040] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.340289] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.340454] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1240.340593] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.340773] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-37" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.341083] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.341259] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.341378] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.341686] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.341827] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c9771b-3edc-4caf-9e91-6a9606a7ff0e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.539724] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.539997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.539997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.541210] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.541210] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7f61dec-b388-42bf-a309-826f7d4ec771 already deleted. [ 1240.541210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.604073] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.604073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.604073] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.604785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.604973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.605224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.605402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.605402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.605570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.605651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.605763] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 is going to be updated. [ 1240.630022] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.630175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.630249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.630450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.630589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.638282] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: IN_PROGRESS for 2s [ 1240.844987] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.845317] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.845453] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.845744] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.845904] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.846132] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 82c9771b-3edc-4caf-9e91-6a9606a7ff0e not found, creating... [ 1240.846423] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.846588] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.846710] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.846942] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.847116] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.847419] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.847581] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.847704] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.847920] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.848078] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.848223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 82c9771b-3edc-4caf-9e91-6a9606a7ff0e is going to be created. [ 1240.866489] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.866489] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.866695] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.866793] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.867022] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.867378] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.295221] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1241.295517] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.546964] env[69728]: INFO networking_nsxv3.common.synchronization [req-1fa6a6bf-2f9f-410a-8d55-f0554b23a2fc req-f4f23109-7fcb-4222-8874-ba9ac78265a3 service nova] Enqueued Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_rules [ 1241.547200] env[69728]: INFO networking_nsxv3.common.synchronization [req-1fa6a6bf-2f9f-410a-8d55-f0554b23a2fc req-f4f23109-7fcb-4222-8874-ba9ac78265a3 service nova] Enqueued Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_members [ 1241.547352] env[69728]: INFO networking_nsxv3.common.synchronization [req-1fa6a6bf-2f9f-410a-8d55-f0554b23a2fc req-f4f23109-7fcb-4222-8874-ba9ac78265a3 service nova] Enqueued Resource ID: 82c9771b-3edc-4caf-9e91-6a9606a7ff0e with Priority: HIGHEST for action port [ 1241.548046] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_rules [ 1241.548046] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_members [ 1241.548046] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c9771b-3edc-4caf-9e91-6a9606a7ff0e with Priority: HIGHEST for action port [ 1241.550783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.550945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.550999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.551252] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.551337] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.552393] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.552449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.552494] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.553079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.553251] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.553516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.553516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.559363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.559363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.559363] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.559363] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.559363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.559363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.559363] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.559363] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c9771b-3edc-4caf-9e91-6a9606a7ff0e',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.055950] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.058389] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82c9771b-3edc-4caf-9e91-6a9606a7ff0e with status ACTIVE [ 1242.059140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.059140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.059140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.059140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.059140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.059449] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.059449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.059449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.059603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.059603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.059783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.060012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.060012] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.060119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.060154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.060215] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82c9771b-3edc-4caf-9e91-6a9606a7ff0e is going to be updated. [ 1242.061276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.061371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.082015] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.082183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.082244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.082445] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.082583] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.082740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c9771b-3edc-4caf-9e91-6a9606a7ff0e" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.380341] env[69728]: INFO networking_nsxv3.common.synchronization [req-99a341da-4581-40f6-b21a-983fc9b30b95 req-28969e6c-28e0-4eaf-9574-9093307e6c66 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1242.380857] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1242.381190] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.381306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.381364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.382541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.382750] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.382868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.382933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.385216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.385216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.385216] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.557687] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.648261] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 in Status: SUCCESS [ 1242.648261] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f54ce0c-aa48-4762-b91f-bbd54dc523d9 deletion is rescheduled due to dependency. [ 1242.648261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f54ce0c-aa48-4762-b91f-bbd54dc523d9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.689019] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.689019] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.689019] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.689019] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.689612] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1242.689835] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1242.690064] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1242.690277] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1242.690484] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1242.690726] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1242.708978] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1242.709348] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1242.709575] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1242.709836] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.710264] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.710580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.710827] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.711230] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.711468] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d8cf61-c4e5-4b35-bd56-635a01a55d6f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.887050] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.060475] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.060706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.060787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.061015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.061114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.061217] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7f61dec-b388-42bf-a309-826f7d4ec771 is going to be created. [ 1243.091972] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.092515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.092515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.092515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.092651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.101694] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7f61dec-b388-42bf-a309-826f7d4ec771 in Status: UNINITIALIZED for 2s [ 1243.218555] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.218808] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.218941] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.219364] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.219528] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.219727] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port a9d8cf61-c4e5-4b35-bd56-635a01a55d6f not found, creating... [ 1243.220029] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.220202] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.220324] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.220554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.220696] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.220992] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.221209] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.221349] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.221564] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.221702] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.221859] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: a9d8cf61-c4e5-4b35-bd56-635a01a55d6f is going to be created. [ 1243.246903] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.247211] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.247408] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.247756] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.248096] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.248417] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.389779] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.892186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.892328] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.892427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.892688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.892825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.892892] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1243.909645] env[69728]: INFO networking_nsxv3.common.synchronization [req-99a341da-4581-40f6-b21a-983fc9b30b95 req-f685caaf-273b-4dd1-8ea2-40f8ae87fd36 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1243.909924] env[69728]: INFO networking_nsxv3.common.synchronization [req-99a341da-4581-40f6-b21a-983fc9b30b95 req-f685caaf-273b-4dd1-8ea2-40f8ae87fd36 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1243.910063] env[69728]: INFO networking_nsxv3.common.synchronization [req-99a341da-4581-40f6-b21a-983fc9b30b95 req-f685caaf-273b-4dd1-8ea2-40f8ae87fd36 service nova] Enqueued Resource ID: a9d8cf61-c4e5-4b35-bd56-635a01a55d6f with Priority: HIGHEST for action port [ 1243.910666] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1243.910826] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1243.910950] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9d8cf61-c4e5-4b35-bd56-635a01a55d6f with Priority: HIGHEST for action port [ 1243.911281] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.911454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.911550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.911760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.911951] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.913142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.913263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.913495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.913618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.913717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.913908] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.914038] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d8cf61-c4e5-4b35-bd56-635a01a55d6f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.920645] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.920797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.920925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.921079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.921236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.929861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1244.416611] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.416891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.416891] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9d8cf61-c4e5-4b35-bd56-635a01a55d6f with status ACTIVE [ 1244.417072] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.417118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.417287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.417513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.417604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.417786] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.417883] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.418148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.418148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.418440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.418440] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.418682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.418682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.418682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.418811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.418811] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9d8cf61-c4e5-4b35-bd56-635a01a55d6f is going to be updated. [ 1244.438717] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.439344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.439344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.439344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.439344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.439527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9d8cf61-c4e5-4b35-bd56-635a01a55d6f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.112224] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7f61dec-b388-42bf-a309-826f7d4ec771 in Status: SUCCESS [ 1245.112431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.112590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.112969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.113208] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.113330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.113402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.113562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.113643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.113727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.113818] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.618514] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.618822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.618822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.618973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.619156] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.619259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.619325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.619505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.619597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.619709] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.619903] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.620016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.620114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.620270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.620411] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.620502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.620561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.620696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.620768] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.620845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.620935] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.939831] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1245.940035] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.940219] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.940489] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.940750] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.940889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.941077] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.941277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.941386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.941618] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.125034] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7f61dec-b388-42bf-a309-826f7d4ec771: rpc.has_security_group_logging(os_id): False [ 1246.149614] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.149869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.149990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.150714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.150714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.150714] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.150714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.150974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.150974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.151048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.151214] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.151346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.151417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.151614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.151719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.151947] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.152109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.152174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.152331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.152411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.152724] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7f61dec-b388-42bf-a309-826f7d4ec771 is going to be created. [ 1246.236579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.236738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.236822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.237092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.237325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.247272] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7f61dec-b388-42bf-a309-826f7d4ec771 in Status: IN_PROGRESS for 2s [ 1246.444109] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.946935] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.449052] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.449052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.449052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.449253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.449304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.449412] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1247.476676] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.476825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.476873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.477106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.477253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.485417] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1248.260942] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7f61dec-b388-42bf-a309-826f7d4ec771 in Status: SUCCESS [ 1248.262409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.912270] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.912399] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1249.495926] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1249.496251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.496449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.496693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.496955] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.497163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.497245] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.497490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.497586] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.497724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.497846] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.002054] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.002234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.002293] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.002504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.002698] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.003099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.003099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.003099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.003233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.003330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.003431] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.003483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.003546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.003740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.003865] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.003960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.004058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.004208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.004307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.004410] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.004490] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.422186] env[69728]: INFO networking_nsxv3.common.synchronization [req-4187dde6-7320-45ac-a601-e23af6ff5f37 req-711058f1-b9f2-4558-8278-7940f6ec70b4 tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_members [ 1250.422186] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_members [ 1250.422186] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.422186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.422186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.422186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.422793] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.423078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.423267] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.423593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.423797] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.424070] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.507905] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1250.529457] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.529556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.529556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.529831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.530026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.531038] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.531038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.531038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.531038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.531038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.531038] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.531948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.531948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.531948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.531948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.532197] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.533071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.533364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.533364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.533771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.533771] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1250.594206] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.594535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.594535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.594790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.594893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.611505] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1250.778412] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.778412] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.778412] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.778412] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.778412] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1250.778939] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1250.778939] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1250.778939] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1250.778939] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1250.778939] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1250.799840] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1250.799840] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1250.799840] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1250.800812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-681" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.800812] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-52819d47-45ac-4c55-b1dc-c8dd420ee451 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.800812] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.801045] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.801297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.801491] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52819d47-45ac-4c55-b1dc-c8dd420ee451',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.930926] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.931241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.931241] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.931454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.931732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.931835] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.931939] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.932083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.932323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.932323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.932512] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 already deleted. [ 1250.932512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.306330] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.306757] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.307015] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.307517] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.307798] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.308022] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 52819d47-45ac-4c55-b1dc-c8dd420ee451 not found, creating... [ 1251.308539] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.308780] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.308947] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.309383] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.309635] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.310181] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.310456] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.310651] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.311060] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.311289] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.311536] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 52819d47-45ac-4c55-b1dc-c8dd420ee451 is going to be created. [ 1251.337455] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.337708] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.337795] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.338094] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.338331] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.338559] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.730403] env[69728]: INFO networking_nsxv3.common.synchronization [req-d25204c6-edc6-4f47-86d8-2c83b2cf2d6a req-4f356188-9778-480f-99aa-9c78fdb01654 tempest-ServerPasswordTestJSON-1675417364 tempest-ServerPasswordTestJSON-1675417364-project-member] Enqueued Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_members [ 1251.731215] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGHEST for action security_group_members [ 1251.731621] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.731750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.731822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.732074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.732236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.732401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.732401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.732559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.732677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.736026] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.045544] env[69728]: INFO networking_nsxv3.common.synchronization [req-4187dde6-7320-45ac-a601-e23af6ff5f37 req-896e889b-5ac0-46c0-b1a5-5447cb0d8586 service nova] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_rules [ 1252.045671] env[69728]: INFO networking_nsxv3.common.synchronization [req-4187dde6-7320-45ac-a601-e23af6ff5f37 req-896e889b-5ac0-46c0-b1a5-5447cb0d8586 service nova] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_members [ 1252.045938] env[69728]: INFO networking_nsxv3.common.synchronization [req-4187dde6-7320-45ac-a601-e23af6ff5f37 req-896e889b-5ac0-46c0-b1a5-5447cb0d8586 service nova] Enqueued Resource ID: 52819d47-45ac-4c55-b1dc-c8dd420ee451 with Priority: HIGHEST for action port [ 1252.046428] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_rules [ 1252.046595] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_members [ 1252.046692] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52819d47-45ac-4c55-b1dc-c8dd420ee451 with Priority: HIGHEST for action port [ 1252.046989] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.048927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.049053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.049359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.049479] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.050426] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.050608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.050721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.050947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.051164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.051351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.051394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.051594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.051693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.051869] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.052775] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-52819d47-45ac-4c55-b1dc-c8dd420ee451 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.052916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.052952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.053110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.053271] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52819d47-45ac-4c55-b1dc-c8dd420ee451',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.235128] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.235348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.235348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.235552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.235628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.235820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.235944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.236020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.236167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.236240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.236331] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7f61dec-b388-42bf-a309-826f7d4ec771 is going to be updated. [ 1252.265742] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.265916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.265967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.266204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.266378] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.275404] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7f61dec-b388-42bf-a309-826f7d4ec771 in Status: IN_PROGRESS for 2s [ 1252.555549] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.555689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.555914] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.559040] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52819d47-45ac-4c55-b1dc-c8dd420ee451 with status ACTIVE [ 1252.559194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.559194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.559344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.559518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.559632] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.560058] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.560058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.560058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.560562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.560562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.560562] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.560562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.560562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.560972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.560972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.560972] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52819d47-45ac-4c55-b1dc-c8dd420ee451 is going to be updated. [ 1252.581212] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.581354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.581416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.581685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.581745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.581904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52819d47-45ac-4c55-b1dc-c8dd420ee451" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.626600] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1252.626818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.058482] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.561470] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.561674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.561716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.561932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.562064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.562182] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 is going to be created. [ 1253.584046] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.584255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.584358] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.584639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.584759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.595706] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 in Status: UNINITIALIZED for 2s [ 1254.284251] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7f61dec-b388-42bf-a309-826f7d4ec771 in Status: SUCCESS [ 1254.284620] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7f61dec-b388-42bf-a309-826f7d4ec771 deletion is rescheduled due to dependency. [ 1254.284620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.605943] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 in Status: SUCCESS [ 1255.606373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.606477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.606779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.607059] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.607236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.607348] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.607585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.607699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.607825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.607952] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.111423] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.614907] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a462be84-fe9b-4f93-8ae7-127e786dbff3: rpc.has_security_group_logging(os_id): False [ 1256.634313] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.634313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.634313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.634313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.634313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.634313] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.634313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.634313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.634781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.634781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.634781] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 is going to be created. [ 1256.688881] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.689187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.689187] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.689436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.689619] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.700761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 in Status: IN_PROGRESS for 2s [ 1257.050073] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.050073] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1258.713192] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 in Status: SUCCESS [ 1258.713488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.058506] env[69728]: INFO networking_nsxv3.common.synchronization [None req-89785152-c7fb-4d76-a532-7fe4f6840dc3 None None] Enqueued Resource ID: 83966642-85b9-4a70-a3b4-278ed8da5537 with Priority: HIGHEST for action port [ 1261.059525] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83966642-85b9-4a70-a3b4-278ed8da5537 with Priority: HIGHEST for action port [ 1261.059728] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-83966642-85b9-4a70-a3b4-278ed8da5537 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.059873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83966642-85b9-4a70-a3b4-278ed8da5537" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.059918] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83966642-85b9-4a70-a3b4-278ed8da5537" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.061516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83966642-85b9-4a70-a3b4-278ed8da5537" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.067491] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83966642-85b9-4a70-a3b4-278ed8da5537',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.230066] env[69728]: INFO networking_nsxv3.common.synchronization [None req-878cbd50-871a-4cc5-a505-23b1b0d46763 tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_rules [ 1261.230066] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_rules [ 1261.230066] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.230066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.230066] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.230461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.231417] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.302468] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b13f139c-4573-4615-bd82-d6df88ceef5d tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_rules [ 1261.303063] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_rules [ 1261.303390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.303460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.565822] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83966642-85b9-4a70-a3b4-278ed8da5537 [ 1261.567276] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.567276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.567276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.567276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.567276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.567276] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83966642-85b9-4a70-a3b4-278ed8da5537 already deleted. [ 1261.567276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83966642-85b9-4a70-a3b4-278ed8da5537" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.752224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.752369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.752439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.752664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.752744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.752868] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 already deleted. [ 1261.752910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.753113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.753282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.753367] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.272622] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.272935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.272935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.273091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.273140] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.273235] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 already deleted. [ 1262.273319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.559617] env[69728]: INFO networking_nsxv3.common.synchronization [req-26c3f89d-b161-482c-bc48-e4bc3f7e9897 req-06a2b1ff-89a5-474f-9aa6-ce1cfa14f4b8 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1262.561359] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1262.561750] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.564763] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.564763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.564763] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.066228] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.077252] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.077735] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.077886] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.078436] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.078767] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.079158] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.079339] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.079692] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.080014] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.081626] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.081626] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1263.081626] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1263.081626] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1263.081626] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1263.081626] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1263.081626] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1263.100131] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1263.100625] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1263.100790] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1263.100985] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.101376] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-9faaaec0-c733-40a2-a3a1-139637eaf96a taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.101488] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.101608] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.103366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.103633] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9faaaec0-c733-40a2-a3a1-139637eaf96a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.182555] env[69728]: INFO networking_nsxv3.common.synchronization [req-722154ed-93cc-4803-8fd1-656016e429b4 req-9254796e-2b4b-45d8-a77d-9d8173e371c5 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_members [ 1263.183141] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f with Priority: HIGHEST for action security_group_members [ 1263.183886] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.183886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.183886] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.184053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.184284] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.184431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.184615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.184907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.185097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.185245] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a77ce3ca-085e-4feb-bd39-e12a2a43bc4f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.430249] env[69728]: INFO networking_nsxv3.common.synchronization [None req-df5238f8-1cf4-40e8-88a2-2db3ad9bbcea None None] Enqueued Resource ID: fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9 with Priority: HIGHEST for action port [ 1263.430249] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9 with Priority: HIGHEST for action port [ 1263.430880] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.431221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.431454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.431858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.432132] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.568657] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.606493] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.606855] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.607104] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.607911] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.608381] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.608510] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 9faaaec0-c733-40a2-a3a1-139637eaf96a not found, creating... [ 1263.608840] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.609382] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.609630] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.610028] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.610340] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.611190] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.611452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.611646] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.611923] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.612125] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.612384] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 9faaaec0-c733-40a2-a3a1-139637eaf96a is going to be created. [ 1263.634031] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.634239] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.634239] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.634486] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.634728] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.634997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.688609] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.688774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.688841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.689095] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.689184] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.689380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.689480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.689543] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.689701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.689779] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.689867] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f is going to be updated. [ 1263.740075] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.740232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.740304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.740518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.740658] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.750037] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f in Status: IN_PROGRESS for 2s [ 1263.935202] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9 [ 1263.935503] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.935590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.935676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.935971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.936366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.936506] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9 already deleted. [ 1263.936563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fedf73c3-f8d3-47eb-8a5d-f5ac0373c6e9" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.075194] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.075451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.075512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.075716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.076189] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.076189] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1264.100558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.100708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.100777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.100992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.101142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.109555] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1264.588196] env[69728]: INFO networking_nsxv3.common.synchronization [req-26c3f89d-b161-482c-bc48-e4bc3f7e9897 req-57416813-b769-428a-aae1-66b962a9807e service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1264.588430] env[69728]: INFO networking_nsxv3.common.synchronization [req-26c3f89d-b161-482c-bc48-e4bc3f7e9897 req-57416813-b769-428a-aae1-66b962a9807e service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1264.588916] env[69728]: INFO networking_nsxv3.common.synchronization [req-26c3f89d-b161-482c-bc48-e4bc3f7e9897 req-57416813-b769-428a-aae1-66b962a9807e service nova] Enqueued Resource ID: 9faaaec0-c733-40a2-a3a1-139637eaf96a with Priority: HIGHEST for action port [ 1264.589218] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1264.589391] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1264.589518] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9faaaec0-c733-40a2-a3a1-139637eaf96a with Priority: HIGHEST for action port [ 1264.590214] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.590214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.590337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.590597] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.590712] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.592015] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.592118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.592316] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9faaaec0-c733-40a2-a3a1-139637eaf96a taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.592413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.592479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.592696] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.593059] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9faaaec0-c733-40a2-a3a1-139637eaf96a',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.094677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.094677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.094885] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9faaaec0-c733-40a2-a3a1-139637eaf96a with status ACTIVE [ 1265.095126] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.095284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.095357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.095572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.095663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.095838] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.095934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.095997] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.096174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.096255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.096442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.096534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.096594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.096737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.096812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.096895] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9faaaec0-c733-40a2-a3a1-139637eaf96a is going to be updated. [ 1265.116304] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.116454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.116505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.116765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.116833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.116988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9faaaec0-c733-40a2-a3a1-139637eaf96a" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.758108] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f in Status: SUCCESS [ 1265.758511] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a77ce3ca-085e-4feb-bd39-e12a2a43bc4f deletion is rescheduled due to dependency. [ 1265.758511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a77ce3ca-085e-4feb-bd39-e12a2a43bc4f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.119767] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1266.119945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.120181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.120347] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.120521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.120630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.120691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.120843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.120923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.121026] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.625411] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.927094] env[69728]: INFO networking_nsxv3.common.synchronization [req-b62d20ee-2c09-4867-be84-35f65143e1e6 req-9d14871e-dac9-4aa4-87a7-6cde47cb1696 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1266.927636] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1266.927937] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.928070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.928138] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.928333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.928621] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.928621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.928621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.929045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.929045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.929045] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.127485] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.430543] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.430725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.430777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.431014] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.431107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.431692] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.431692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.431692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.431692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.431692] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.431910] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1267.459613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.459767] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.459825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.460034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.460174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.468059] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1267.629913] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.630009] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.630099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.630285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.630388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.630490] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1267.657213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.657365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.657407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.657613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.657757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.666018] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1268.706238] env[69728]: INFO networking_nsxv3.common.synchronization [req-fa76d73a-8c16-476c-a6ee-387dd8f47c75 req-fa59d9bf-f8c5-425f-b054-ea2bf94698af tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_members [ 1268.706781] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_members [ 1268.707123] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.707251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.707313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.707665] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.707734] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.707846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.707914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.709775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.709888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.709991] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.053419] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.053419] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.053419] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.053901] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.054214] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.054486] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.054554] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.054878] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.055099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.055355] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.055503] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1269.055641] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1269.055780] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1269.055920] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1269.056141] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1269.056333] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1269.074781] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1269.074955] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1269.075155] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1269.075336] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.075637] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-3092548d-72ed-469c-ae78-cef480f00240 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.075808] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.075931] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.076293] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.076438] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3092548d-72ed-469c-ae78-cef480f00240',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.212707] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.212941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.212941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.213180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.213274] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.213476] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.213567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.213637] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.213774] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.213851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.213959] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 already deleted. [ 1269.214041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.479074] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1269.479074] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1269.479074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.579282] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.579515] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.579649] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.579944] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.580120] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.580283] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 3092548d-72ed-469c-ae78-cef480f00240 not found, creating... [ 1269.580532] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.581361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.581361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.581361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.581361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.581582] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.581640] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.581729] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.581936] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.582190] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.585019] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 3092548d-72ed-469c-ae78-cef480f00240 is going to be created. [ 1269.601940] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.602141] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.602479] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.602872] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.603555] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.603555] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.684043] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1269.684043] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.684208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.684425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.684711] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.684890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.685045] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.685283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.685372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.685465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.685714] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.190506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.190802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.190802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.190937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.191121] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.191214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.191276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.192097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.192097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.192097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.192097] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.192097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.192097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.192097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.192312] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.192312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.192312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.192414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.192495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.192615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.192654] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.696579] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1270.714184] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.714340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.714384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.714585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.714674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.714883] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.715018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.715068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.715242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.715320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.715519] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.715611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.715672] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.715812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.715884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.716234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.716375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.716461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.716631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.716716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.716809] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1270.763806] env[69728]: INFO networking_nsxv3.common.synchronization [req-fa76d73a-8c16-476c-a6ee-387dd8f47c75 req-ca0ac688-0545-432b-8e87-47e4dda0b347 service nova] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_rules [ 1270.763993] env[69728]: INFO networking_nsxv3.common.synchronization [req-fa76d73a-8c16-476c-a6ee-387dd8f47c75 req-ca0ac688-0545-432b-8e87-47e4dda0b347 service nova] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_members [ 1270.764152] env[69728]: INFO networking_nsxv3.common.synchronization [req-fa76d73a-8c16-476c-a6ee-387dd8f47c75 req-ca0ac688-0545-432b-8e87-47e4dda0b347 service nova] Enqueued Resource ID: 3092548d-72ed-469c-ae78-cef480f00240 with Priority: HIGHEST for action port [ 1270.764627] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_rules [ 1270.764829] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_members [ 1270.764893] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3092548d-72ed-469c-ae78-cef480f00240 with Priority: HIGHEST for action port [ 1270.765232] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.765294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.765364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.765553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.765634] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.766482] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.766574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.766641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.766822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.766991] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.767106] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.767168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.767338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.767452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.767548] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.768306] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-3092548d-72ed-469c-ae78-cef480f00240 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.769027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.769027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.769027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.769027] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3092548d-72ed-469c-ae78-cef480f00240',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.774864] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.774864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.774864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.774864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.774864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.788935] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1271.270342] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.270695] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.270790] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.271933] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3092548d-72ed-469c-ae78-cef480f00240 with status ACTIVE [ 1271.272593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.272593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.272593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.272899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.272899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.273084] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.273240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.273380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.273533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.273662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.273921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.274218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.274218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.274355] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.274460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.274575] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3092548d-72ed-469c-ae78-cef480f00240 is going to be updated. [ 1271.299053] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.299053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.299053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.299053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.299053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.299053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3092548d-72ed-469c-ae78-cef480f00240" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.777109] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.279463] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.279891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.279891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.279891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.280089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.280124] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 is going to be created. [ 1272.302846] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.303098] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.303203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.303394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.303588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.312114] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: UNINITIALIZED for 2s [ 1272.803298] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1272.803538] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.321306] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: SUCCESS [ 1274.321595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.321685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.321897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.322097] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.322212] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.322277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.322426] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.322508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.322591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.322680] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.825980] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.328154] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70125447-a5e8-40f4-9e86-0caf7c8e5712: rpc.has_security_group_logging(os_id): False [ 1275.347350] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.347528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.347603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.347889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.347959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.348233] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.348354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.348422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.348681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.348681] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.348793] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 is going to be created. [ 1275.409963] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.410156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.410220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.410440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.410626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.420811] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: IN_PROGRESS for 2s [ 1275.709509] env[69728]: INFO networking_nsxv3.common.synchronization [req-5ab28283-1c82-4a71-9e5e-fd5719cfb3c3 req-49ba607c-c740-4c5d-b58a-1f14ed484db9 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1275.710125] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1275.710466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.710624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.710700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.710962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.711132] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.711248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.711329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.711546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.711641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.711740] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.213758] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.716095] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.881122] env[69728]: INFO networking_nsxv3.common.synchronization [req-63e05084-1ae3-49a2-bb0d-f88501e56377 req-dd02bae3-fc9c-45ea-be4f-ad5d645146e1 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1276.881694] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1276.882023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.886456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.886526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.886817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.887245] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.887414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.887508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.887706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.887825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.888096] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.219463] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.219645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.219685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.219889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.219976] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.220099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1277.249548] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.249548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.249548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.249548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.249548] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.256055] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1277.393716] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.393945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.393945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.394227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.394321] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.394525] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.394638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.394733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.394823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.394882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.394976] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1277.418796] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.419112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.419112] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.419359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.419492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.428850] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1277.434223] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: SUCCESS [ 1277.434223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.003675] env[69728]: INFO networking_nsxv3.common.synchronization [req-0b0c0b20-61d6-444b-8fbb-2358b3de2b9a req-3e994a38-cee8-4d4c-a786-30e62514b60b tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1278.004094] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1278.005375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.005375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.005375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.005375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.005375] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.005375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.005375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.006248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.006248] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.006248] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.079187] env[69728]: INFO networking_nsxv3.common.synchronization [req-c6736137-a2e7-4ef3-bba1-7dc180a78284 req-58acbb22-61dd-42c3-9f3b-57d0a3a8cb99 tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1278.080287] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1278.080582] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.080746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.080827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.081107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.081277] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.081380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.081442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.082109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.082109] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.082109] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.237697] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.237906] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.238051] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.238328] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.238591] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.238753] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.238875] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.239106] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.239262] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.239510] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.240030] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1278.240149] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1278.240267] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1278.240389] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1278.240519] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1278.240662] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1278.260057] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1278.260158] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1278.260301] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1278.260476] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.260771] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-9c40a43e-3c41-4190-902f-56051f3d5b01 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.260937] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.261248] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.261582] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.261723] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c40a43e-3c41-4190-902f-56051f3d5b01',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.508119] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.584514] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.764224] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.764468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.764852] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.764909] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.765040] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.765336] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 9c40a43e-3c41-4190-902f-56051f3d5b01 not found, creating... [ 1278.765620] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.765790] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.765912] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.766154] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.766301] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.766588] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.766754] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.766887] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.767084] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.767228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.767398] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 9c40a43e-3c41-4190-902f-56051f3d5b01 is going to be created. [ 1278.787430] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.787624] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.787754] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.788091] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.788343] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.788572] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.010568] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.086688] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.265234] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1279.265442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.437688] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1279.437877] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1279.437989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.514264] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.514432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.514507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.514722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.514814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.514918] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 1279.539790] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.539790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.539790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.539986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.540047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.549263] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 1279.588868] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.589037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.589160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.589337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.589427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.589528] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be updated. [ 1279.612157] env[69728]: INFO networking_nsxv3.common.synchronization [req-63e05084-1ae3-49a2-bb0d-f88501e56377 req-6a65af8f-93d4-4220-934d-38ffa5a34397 service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1279.612340] env[69728]: INFO networking_nsxv3.common.synchronization [req-63e05084-1ae3-49a2-bb0d-f88501e56377 req-6a65af8f-93d4-4220-934d-38ffa5a34397 service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1279.612485] env[69728]: INFO networking_nsxv3.common.synchronization [req-63e05084-1ae3-49a2-bb0d-f88501e56377 req-6a65af8f-93d4-4220-934d-38ffa5a34397 service nova] Enqueued Resource ID: 9c40a43e-3c41-4190-902f-56051f3d5b01 with Priority: HIGHEST for action port [ 1279.612980] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1279.613235] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1279.613277] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c40a43e-3c41-4190-902f-56051f3d5b01 with Priority: HIGHEST for action port [ 1279.614431] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.614556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.614823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.614874] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.614973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.616151] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.616383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.616383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.616537] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.616575] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.617479] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.617636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.617705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.617859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.618011] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.618110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.618173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.618310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.618388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.618477] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.620539] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c40a43e-3c41-4190-902f-56051f3d5b01 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.620641] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.620703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.620853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.620926] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c40a43e-3c41-4190-902f-56051f3d5b01',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.633613] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1279.859483] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.859483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.859483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.859483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.859483] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.859483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.859819] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.859819] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.859937] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.860719] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.860837] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1279.860951] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1279.861080] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1279.861196] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1279.861302] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1279.861433] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1279.879917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1279.879917] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1279.879917] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1279.880137] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-200" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.880308] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-54139ea7-7b3b-4e12-8d85-303217804f72 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.880483] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.880614] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.880874] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.881031] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54139ea7-7b3b-4e12-8d85-303217804f72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.123462] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.123462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.124388] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.124520] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c40a43e-3c41-4190-902f-56051f3d5b01 with status ACTIVE [ 1280.124706] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.124817] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.124930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.125191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.125285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.125466] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.125875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.125875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.125875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.125875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.126064] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.126145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.126243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.126376] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.126459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.127111] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c40a43e-3c41-4190-902f-56051f3d5b01 is going to be updated. [ 1280.148558] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.148719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.150458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.150458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.150458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.150458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c40a43e-3c41-4190-902f-56051f3d5b01" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.385176] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.385502] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.385666] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.385983] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.386536] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.386536] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.386933] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.386933] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.387657] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.387657] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.387792] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.387986] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.388173] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.388429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.388607] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.388791] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 54139ea7-7b3b-4e12-8d85-303217804f72 is going to be updated. [ 1280.417637] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.417637] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.417830] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.417984] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.418204] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.418431] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.628511] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.131123] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.131403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.131403] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.131574] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.131657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.131763] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1281.158154] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.158315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.158368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.158569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.158783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.167652] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1281.240678] env[69728]: INFO networking_nsxv3.common.synchronization [req-91b171c4-4e24-4ea3-8f4a-50d55148859d req-8c767afe-81fd-41a8-819b-8f370aa3906e service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 1281.240967] env[69728]: INFO networking_nsxv3.common.synchronization [req-91b171c4-4e24-4ea3-8f4a-50d55148859d req-8c767afe-81fd-41a8-819b-8f370aa3906e service nova] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1281.240967] env[69728]: INFO networking_nsxv3.common.synchronization [req-91b171c4-4e24-4ea3-8f4a-50d55148859d req-8c767afe-81fd-41a8-819b-8f370aa3906e service nova] Enqueued Resource ID: 54139ea7-7b3b-4e12-8d85-303217804f72 with Priority: HIGHEST for action port [ 1281.241220] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_rules [ 1281.241347] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1281.241444] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54139ea7-7b3b-4e12-8d85-303217804f72 with Priority: HIGHEST for action port [ 1281.242534] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.242723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.242844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.243286] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.244180] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.245009] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.246026] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.246026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.246026] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.246766] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-54139ea7-7b3b-4e12-8d85-303217804f72 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.246877] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.246968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.247110] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.247186] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54139ea7-7b3b-4e12-8d85-303217804f72',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.560583] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 1281.561042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.645899] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1281.645899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.750388] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.750584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.750735] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.751660] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54139ea7-7b3b-4e12-8d85-303217804f72 with status ACTIVE [ 1281.751834] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.751944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.752017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.752322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.752388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.752520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.752610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.752674] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.752806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.752882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.755498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.755789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.755993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.756621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.756621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.756621] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54139ea7-7b3b-4e12-8d85-303217804f72 is going to be updated. [ 1281.777808] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.777808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.777808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.777808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.777808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.777808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54139ea7-7b3b-4e12-8d85-303217804f72" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.259889] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.762423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.762609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.762684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.762999] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.763178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.763307] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1282.790908] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.791090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.791139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.791406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.791588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.799805] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1283.179159] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1283.179381] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.179626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.180430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.180430] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.180430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.180430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.180687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.180737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.180920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.181061] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.683750] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.684419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.684419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.684419] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.684523] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.684635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.684703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.684857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.684946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.685046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.685236] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.685333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.685392] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.685533] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.685673] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.685765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.685823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.685964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.686062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.686240] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.686240] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.023145] env[69728]: INFO networking_nsxv3.common.synchronization [req-a902ed18-c6d3-4b68-9db7-0d166106918b req-6cae7cb9-3036-411e-873c-e734df32b498 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1284.023698] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1284.024141] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.024270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.024336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.024578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.024683] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.024780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.024841] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.024989] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.025091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.025215] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.188239] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb: rpc.has_security_group_logging(os_id): False [ 1284.209439] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.209757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.209757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.209966] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.210087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.210286] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.210440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.210521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.210656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.210734] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.210927] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.211085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.211166] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.211336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.211389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.211612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.211738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.211793] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.211914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.211992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.212093] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1284.271521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.271745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.271792] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.272047] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.272249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.287063] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1284.528362] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.664461] env[69728]: INFO networking_nsxv3.common.synchronization [req-f0eca06c-c950-4588-bf9b-1b1a1cab8b28 req-014d75d2-a32e-4748-a84c-9ae23e8f11b5 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1284.665283] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1284.666024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.666024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.666024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.666191] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.666314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.666427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.666515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.666684] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.666771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.666880] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.816063] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1284.816063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.816063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.816063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.816063] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.816063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.816063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.816063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.817342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.817342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.817342] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.030542] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.169108] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.169281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.169365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.169557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.169652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.169850] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.169948] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.170508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.170508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.170508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.170508] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1285.202074] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.202336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.202336] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.202523] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.202645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.223418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1285.319108] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.533268] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.533456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.533509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.533743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.533830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.533933] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1285.565947] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.566202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.566202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.566536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.566772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.575140] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1285.822568] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 562643dd-522c-4927-b2ad-26c57a85d1e3: rpc.has_security_group_logging(os_id): False [ 1285.846481] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.846673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.846746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.846938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.847049] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.847338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.847485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.847563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.847721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.847803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.847898] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1285.905265] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.905407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.905476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.905690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.905873] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.936783] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1286.357128] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1286.357469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.827266] env[69728]: INFO networking_nsxv3.common.synchronization [req-e4f0d734-d568-4ad8-b5c9-f903777333ae req-e92b116a-2ab8-466b-b34c-0337d957096a tempest-ServerRescueNegativeTestJSON-253277901 tempest-ServerRescueNegativeTestJSON-253277901-project-member] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1286.828320] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGHEST for action security_group_members [ 1286.828869] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.829090] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.830470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.830470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.830470] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.830470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.830470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.830470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.830470] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.830886] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.233496] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1287.233709] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf deletion is rescheduled due to dependency. [ 1287.233824] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.333914] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.334161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.334272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.334590] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.334748] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.335033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.335195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.335278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.335478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.335609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.335721] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be updated. [ 1287.367731] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.367963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.367963] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.368165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.368353] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.377099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: IN_PROGRESS for 2s [ 1287.584893] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1287.585285] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.952445] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1287.952809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.387424] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98ee287a-374d-44ae-b682-134db3270cba in Status: SUCCESS [ 1289.387820] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98ee287a-374d-44ae-b682-134db3270cba deletion is rescheduled due to dependency. [ 1289.387820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.829097] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.829459] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.924143] env[69728]: INFO networking_nsxv3.common.synchronization [req-361e24a0-f8bc-4cdf-b34e-91b7f8260906 req-dc64cb7f-828c-4c3b-b4c2-3c3eb96d840b tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1293.924741] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1293.925142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.925330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.925414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.925621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.925782] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.925936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.926019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.926133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.926221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.926343] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.428732] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.428732] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.428932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.428990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.429186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.429282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.429413] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.429499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.429593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.429673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.429761] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1294.457408] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.458472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.458585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.458822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.458974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.467359] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1296.477153] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1296.477516] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1296.477516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.802869] env[69728]: INFO networking_nsxv3.common.synchronization [req-680b7050-bec4-4fec-a9c3-9bae6e5500d2 req-56228ce7-45e9-4e99-98ed-4203148cb1eb tempest-ServerActionsTestOtherA-1461398888 tempest-ServerActionsTestOtherA-1461398888-project-member] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1297.802869] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGHEST for action security_group_members [ 1297.803825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.803825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.803825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.803825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.805969] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.805969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.805969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.805969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.805969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.805969] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.940542] env[69728]: INFO networking_nsxv3.common.synchronization [req-5e4e4db7-d3e0-4d98-bf20-0b36554dadb7 req-34c9a83a-91db-456e-88ed-49eae2bef4f3 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1297.941082] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1297.941412] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.941529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.941595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.941794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.941947] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.942615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.942742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.942942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.943084] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.943262] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.231051] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-616 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.231258] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.231387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.231660] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.231973] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.232182] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.232308] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.232529] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.232681] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.232901] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1298.233202] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1298.233379] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1298.233602] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1298.233712] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1298.233829] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1298.233966] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1298.253733] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1298.253888] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1298.254104] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1298.255034] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-616" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.255034] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-e56af419-9cad-4fb1-bf00-b7a606d358e6 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.255034] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.255034] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.255429] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.255429] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56af419-9cad-4fb1-bf00-b7a606d358e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.308029] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.308176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.308250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.308485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.308582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.308772] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.308869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.308931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.309108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.309186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.309273] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be updated. [ 1298.336326] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.336468] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.336536] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.336722] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.336858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.344145] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: IN_PROGRESS for 2s [ 1298.445980] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.446169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.446235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.446500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.446599] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.446806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.446906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.447303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.447303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.447303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.447303] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1298.471072] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.471210] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.471279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.471457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.471587] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.479549] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1298.757190] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.757427] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.757562] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.757862] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.758031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.758193] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port e56af419-9cad-4fb1-bf00-b7a606d358e6 not found, creating... [ 1298.758455] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.758622] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.758746] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.759652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.759652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.759652] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.759652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.759652] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.759902] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.760100] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.760181] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: e56af419-9cad-4fb1-bf00-b7a606d358e6 is going to be created. [ 1298.777859] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.778073] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.778203] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.778448] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.778672] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.778893] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.433928] env[69728]: INFO networking_nsxv3.common.synchronization [req-2cfc089c-71b4-4d32-96c8-4240ae9bb34a req-aa2e3f1e-e555-4e65-b8a6-90baa3d4b8b6 tempest-ServerActionsTestOtherB-1367305518 tempest-ServerActionsTestOtherB-1367305518-project-member] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1299.434465] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGHEST for action security_group_members [ 1299.434773] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.434894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.434961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.439278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.439461] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.439572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.439639] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.439803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.439889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.439984] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.724842] env[69728]: INFO networking_nsxv3.common.synchronization [req-5e4e4db7-d3e0-4d98-bf20-0b36554dadb7 req-828abfb5-7dfe-4285-86a9-6f80237aa1ae service nova] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 1299.725027] env[69728]: INFO networking_nsxv3.common.synchronization [req-5e4e4db7-d3e0-4d98-bf20-0b36554dadb7 req-828abfb5-7dfe-4285-86a9-6f80237aa1ae service nova] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1299.725186] env[69728]: INFO networking_nsxv3.common.synchronization [req-5e4e4db7-d3e0-4d98-bf20-0b36554dadb7 req-828abfb5-7dfe-4285-86a9-6f80237aa1ae service nova] Enqueued Resource ID: e56af419-9cad-4fb1-bf00-b7a606d358e6 with Priority: HIGHEST for action port [ 1299.725432] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_rules [ 1299.725556] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1299.725649] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e56af419-9cad-4fb1-bf00-b7a606d358e6 with Priority: HIGHEST for action port [ 1299.726604] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.727465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.727465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.727465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.727465] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.728178] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.728312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.728540] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-e56af419-9cad-4fb1-bf00-b7a606d358e6 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.728703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.728794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.728986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.729107] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e56af419-9cad-4fb1-bf00-b7a606d358e6',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.942423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.942656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.942760] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.943065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.943272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.943516] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.943711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.943838] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.944069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.944205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.944335] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be updated. [ 1299.970323] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.970460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.970531] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.970728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.970880] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.977730] env[69728]: INFO networking_nsxv3.common.synchronization [req-1e8f4f98-886a-479a-baf3-3ed74b72f453 req-c8d817a4-9c1b-4e61-a98c-67bb08d72c4c tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1299.978626] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: IN_PROGRESS for 2s [ 1299.979063] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1299.979397] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.979556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.979651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.979858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.980569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.980569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.980569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.980569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.980569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.980569] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.230491] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.230642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.233497] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e56af419-9cad-4fb1-bf00-b7a606d358e6 with status ACTIVE [ 1300.233497] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.233497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.233497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.233668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.233668] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.233815] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.233910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.233971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.234135] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.234213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.234419] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.234490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.234550] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.235171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.235171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.235171] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e56af419-9cad-4fb1-bf00-b7a606d358e6 is going to be updated. [ 1300.266900] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.267181] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.267264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.267476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.267704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.267773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e56af419-9cad-4fb1-bf00-b7a606d358e6" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.284762] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.285403] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.285403] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.285541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.285724] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.285892] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.286029] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.286259] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.286450] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.286668] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.286788] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1300.286902] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1300.287023] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1300.287141] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1300.287250] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1300.287401] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1300.327999] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1300.328203] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1300.328348] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1300.328529] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.328849] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-4d200037-49c6-4e46-934d-1604cbb9dc6b taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.329042] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.329173] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.329507] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.329651] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d200037-49c6-4e46-934d-1604cbb9dc6b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.355465] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dafae610-4861-4852-9c85-d723484b91f0 in Status: SUCCESS [ 1300.355676] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dafae610-4861-4852-9c85-d723484b91f0 deletion is rescheduled due to dependency. [ 1300.355728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.482730] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.490291] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1300.490508] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf deletion is rescheduled due to dependency. [ 1300.490625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.490778] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.490992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.491244] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.491460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.491589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.491820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.491927] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.492032] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.833074] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.833074] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.833074] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.833503] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.833603] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.833773] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 4d200037-49c6-4e46-934d-1604cbb9dc6b not found, creating... [ 1300.834030] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.834201] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.834323] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.834558] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.834699] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.834985] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.835198] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.835390] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.835656] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.835796] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.835941] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 4d200037-49c6-4e46-934d-1604cbb9dc6b is going to be created. [ 1300.856467] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.856693] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.856826] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.857119] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.857359] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.857594] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.986118] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.994699] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.488179] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.488491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.488491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.488725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.488822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.488924] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1301.498673] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.524677] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.524825] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.524898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.525117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.525263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.541044] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1301.553716] env[69728]: INFO networking_nsxv3.common.synchronization [req-1e8f4f98-886a-479a-baf3-3ed74b72f453 req-3e773e26-6eab-487b-b493-c20d7ece4ea1 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1301.553989] env[69728]: INFO networking_nsxv3.common.synchronization [req-1e8f4f98-886a-479a-baf3-3ed74b72f453 req-3e773e26-6eab-487b-b493-c20d7ece4ea1 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1301.554162] env[69728]: INFO networking_nsxv3.common.synchronization [req-1e8f4f98-886a-479a-baf3-3ed74b72f453 req-3e773e26-6eab-487b-b493-c20d7ece4ea1 service nova] Enqueued Resource ID: 4d200037-49c6-4e46-934d-1604cbb9dc6b with Priority: HIGHEST for action port [ 1301.554416] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1301.554690] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1301.554798] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d200037-49c6-4e46-934d-1604cbb9dc6b with Priority: HIGHEST for action port [ 1301.555497] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.555608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.556024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.556024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.556024] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.557936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.557936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.557936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d200037-49c6-4e46-934d-1604cbb9dc6b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.557936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.557936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.557936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.558209] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d200037-49c6-4e46-934d-1604cbb9dc6b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.988108] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 in Status: SUCCESS [ 1301.988322] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 deletion is rescheduled due to dependency. [ 1301.988441] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.001056] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.001217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.001277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.001490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.001594] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.001690] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1302.026404] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.026552] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.026623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.026864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.027034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.034455] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1302.060116] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.060270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.060479] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d200037-49c6-4e46-934d-1604cbb9dc6b with status ACTIVE [ 1302.060667] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.060784] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.060851] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.061081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.061168] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.061345] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.061442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.061505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.061688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.061770] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.062023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.062127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.062170] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.062316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.062396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.062480] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d200037-49c6-4e46-934d-1604cbb9dc6b is going to be updated. [ 1302.083766] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.083766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.083766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.084119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.084233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.084391] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d200037-49c6-4e46-934d-1604cbb9dc6b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.550758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1303.551032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.551164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.551380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.551570] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.551685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.551800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.551901] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.552144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.552274] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.047019] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1304.047203] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.047383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.047648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.047804] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.047920] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.047986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.048159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.048234] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.048320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.048411] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.053891] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.550271] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.555771] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.052372] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fb31477-cec0-4034-8f2e-e510893e6ddf: rpc.has_security_group_logging(os_id): False [ 1305.058220] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.058357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.058431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.058636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.058726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.058821] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1305.070694] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.070821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.070869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.071071] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.071158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.071391] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.071492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.071706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.071868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.071947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.072046] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1305.088319] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.088440] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.088509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.088677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.088812] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.096273] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1305.134238] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.134345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.134389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.134577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.134727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.151319] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1306.555612] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1306.556306] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1307.106916] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1307.107147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.107303] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.107525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.107712] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.108727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.108727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.108727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.108727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.108727] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.108727] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.164140] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1307.164375] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.614060] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.614926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.614926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.614926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.614926] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.614926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.614926] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.615224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.615224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.615224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.615389] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.615459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.616139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.616790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.616790] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.616790] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.617074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.617074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.617074] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.617178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.617230] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.120870] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1308.139891] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.139891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.139891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.140148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.140148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.140360] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.140466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.140526] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.140716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.140798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.141033] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.141137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.141211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.141343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.141412] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.141617] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.141761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.141827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.142010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.142099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.142295] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1308.198500] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.198630] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.198700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.198905] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.199060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.214023] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1309.436601] env[69728]: INFO networking_nsxv3.common.synchronization [req-aa672bae-0136-4cb5-8a01-5cb77322a943 req-3aef6514-d841-40b3-a2da-d3c75cb55de4 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1309.437148] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1309.437456] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.437572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.437638] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.437869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.438096] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.438190] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.438235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.438374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.438446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.438538] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.647972] env[69728]: INFO networking_nsxv3.common.synchronization [None req-1a1100f0-06e4-41d1-8797-5101818e84fa None None] Enqueued Resource ID: cc766141-2c8b-4748-8eec-669476450929 with Priority: HIGHEST for action port [ 1309.651644] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc766141-2c8b-4748-8eec-669476450929 with Priority: HIGHEST for action port [ 1309.651644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc766141-2c8b-4748-8eec-669476450929 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.651644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc766141-2c8b-4748-8eec-669476450929" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.651644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc766141-2c8b-4748-8eec-669476450929" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.651644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc766141-2c8b-4748-8eec-669476450929" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.651644] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc766141-2c8b-4748-8eec-669476450929',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.940521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.941173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.941280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.941511] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.941610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.942057] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.942057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.942057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.942262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.942262] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.942367] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1309.973191] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.973409] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.973476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.973659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.973809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.981867] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1310.011181] env[69728]: INFO networking_nsxv3.common.synchronization [None req-cccd2f3b-d681-4250-be39-39f16db31e9b tempest-ServerActionsV293TestJSON-143764121 tempest-ServerActionsV293TestJSON-143764121-project-member] Enqueued Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_rules [ 1310.011885] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_rules [ 1310.012794] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.012973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.013134] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.013618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.013872] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.122195] env[69728]: INFO networking_nsxv3.common.synchronization [None req-57a58f82-febc-4978-9b3a-5df1b5d4a757 tempest-ServerActionsV293TestJSON-143764121 tempest-ServerActionsV293TestJSON-143764121-project-member] Enqueued Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_rules [ 1310.123926] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_rules [ 1310.125147] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.125962] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.126396] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.126891] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.127881] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.127881] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.128061] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.130217] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.130217] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.130217] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1310.130217] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1310.130217] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1310.130548] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1310.130964] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1310.131257] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1310.132274] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1310.134569] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.134569] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.154387] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1310.154387] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1310.154387] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1310.154387] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.154722] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.154894] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.155028] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.155388] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.155549] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.158397] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc766141-2c8b-4748-8eec-669476450929 [ 1310.158500] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.158648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.158648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.160620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.160756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.160916] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc766141-2c8b-4748-8eec-669476450929 already deleted. [ 1310.161122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc766141-2c8b-4748-8eec-669476450929" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.231747] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1310.231747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.542200] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.542504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.542504] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.542634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.542723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.542842] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 already deleted. [ 1310.543220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.543220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.543220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.543417] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.662106] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.662361] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.662620] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.662778] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.662936] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.663109] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 not found, creating... [ 1310.663385] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.663547] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.663645] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.663881] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.664028] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.664324] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.664487] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.665285] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.665634] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.665848] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.666418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 is going to be created. [ 1310.686204] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.688468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.688468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.688468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.688468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.688468] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.063017] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.063172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.063263] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.063613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.064436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.064436] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 already deleted. [ 1311.064436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.465941] env[69728]: INFO networking_nsxv3.common.synchronization [req-aa672bae-0136-4cb5-8a01-5cb77322a943 req-fee2aa70-2b9d-440d-a4eb-f8624a7923cd service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1311.466139] env[69728]: INFO networking_nsxv3.common.synchronization [req-aa672bae-0136-4cb5-8a01-5cb77322a943 req-fee2aa70-2b9d-440d-a4eb-f8624a7923cd service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1311.466287] env[69728]: INFO networking_nsxv3.common.synchronization [req-aa672bae-0136-4cb5-8a01-5cb77322a943 req-fee2aa70-2b9d-440d-a4eb-f8624a7923cd service nova] Enqueued Resource ID: ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 with Priority: HIGHEST for action port [ 1311.466646] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1311.466774] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1311.466875] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 with Priority: HIGHEST for action port [ 1311.467739] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.467739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.467739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.467893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.467985] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.468882] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.468980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.469241] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.469359] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.469415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.469606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.469742] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.959698] env[69728]: INFO networking_nsxv3.common.synchronization [None req-4b5ff4e2-6b3c-46f9-a907-78479e3f2e3c None None] Enqueued Resource ID: 081b819f-5668-43b9-9fd0-3ef4422b9291 with Priority: HIGHEST for action port [ 1311.959932] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 081b819f-5668-43b9-9fd0-3ef4422b9291 with Priority: HIGHEST for action port [ 1311.960717] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-081b819f-5668-43b9-9fd0-3ef4422b9291 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.960717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-081b819f-5668-43b9-9fd0-3ef4422b9291" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.960717] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-081b819f-5668-43b9-9fd0-3ef4422b9291" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.961010] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-081b819f-5668-43b9-9fd0-3ef4422b9291" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.961049] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('081b819f-5668-43b9-9fd0-3ef4422b9291',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.971373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.971498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.973423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 with status ACTIVE [ 1311.973423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.973423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.973423] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.973423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.973423] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42 is going to be updated. [ 1311.990341] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1311.990523] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1311.990635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.990777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.990985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.991197] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.991322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.991388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.991546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.991631] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.991742] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.993933] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.994058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.994141] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.994670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.994670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.994670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed5f26c2-b7bd-4d8a-a76a-2ca4c104fa42" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.464559] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 081b819f-5668-43b9-9fd0-3ef4422b9291 [ 1312.464706] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.464706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.464816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.465278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.465278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.465278] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:081b819f-5668-43b9-9fd0-3ef4422b9291 already deleted. [ 1312.465278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-081b819f-5668-43b9-9fd0-3ef4422b9291" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.497372] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.002035] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.046498] env[69728]: INFO networking_nsxv3.common.synchronization [req-4502a94f-798f-4d99-a4ad-1251fe47f9be req-7cc019f1-d182-4805-b5e5-68b07e2225e0 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1313.048062] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1313.048062] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.048062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.048062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.048062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.048062] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.048062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.048062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.048062] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.048555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.048716] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.504740] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.505802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.505802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.505802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.505802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.505802] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1313.534160] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.534160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.534160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.534160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.534160] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.542739] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1313.551037] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.054223] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.424027] env[69728]: INFO networking_nsxv3.common.synchronization [None req-759d79a9-1f39-43b9-9459-c256e585d640 None None] Enqueued Resource ID: 71044326-f0f5-443a-babe-a4b3e4e6ed98 with Priority: HIGHEST for action port [ 1314.424027] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71044326-f0f5-443a-babe-a4b3e4e6ed98 with Priority: HIGHEST for action port [ 1314.424027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-71044326-f0f5-443a-babe-a4b3e4e6ed98 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.424027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71044326-f0f5-443a-babe-a4b3e4e6ed98" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.424308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71044326-f0f5-443a-babe-a4b3e4e6ed98" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.424308] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71044326-f0f5-443a-babe-a4b3e4e6ed98" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.424417] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71044326-f0f5-443a-babe-a4b3e4e6ed98',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.557407] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.558070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.558070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.558070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.558070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.558283] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1314.584356] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.584589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.584589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.584867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.585065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.595469] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1314.914713] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.914935] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.915084] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.915577] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.915785] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.916500] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.916668] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.916912] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.917081] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.917355] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1314.917439] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1314.917565] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1314.917701] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1314.917780] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1314.917891] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1314.918036] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1314.926229] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71044326-f0f5-443a-babe-a4b3e4e6ed98 [ 1314.926427] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.926540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.926609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.926794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.926879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.926972] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71044326-f0f5-443a-babe-a4b3e4e6ed98 already deleted. [ 1314.927067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71044326-f0f5-443a-babe-a4b3e4e6ed98" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.935990] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1314.936150] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1314.936283] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1314.936472] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.936790] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-0a42a28f-6084-4ad3-af20-3e8c15c38458 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.937510] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.937510] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.937769] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.937919] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a42a28f-6084-4ad3-af20-3e8c15c38458',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.223411] env[69728]: INFO networking_nsxv3.common.synchronization [req-e59fb194-928c-4fc7-819b-1799ef2dd7bd req-dcb98559-51ad-4a86-b126-8788e74408bb tempest-AttachVolumeNegativeTest-645617365 tempest-AttachVolumeNegativeTest-645617365-project-member] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_members [ 1315.224091] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGHEST for action security_group_members [ 1315.224476] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.224620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.224704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.224934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.225300] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.225457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.225527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.225713] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.225811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.225909] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.440970] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.440970] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.441377] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.441573] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.441573] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.441844] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.443012] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.443012] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.443012] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.443012] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.443012] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.443012] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.443334] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.443334] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.443424] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.443582] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 is going to be updated. [ 1315.466265] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.466513] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.466653] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.466924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.467838] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.467838] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.554592] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.554592] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.554592] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.554592] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.728333] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.728581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.728646] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.728862] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.728953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.729167] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.729326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.729326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.729465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.729546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.729637] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 is going to be updated. [ 1315.756806] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.756806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.756806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.756806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.756806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.766035] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 in Status: IN_PROGRESS for 2s [ 1316.057644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.057934] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.058044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.058277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.058477] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.058565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.058622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.058780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.058870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.058960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.059123] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.059216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.059280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.059425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.059586] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.059716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.059763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.059869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.059945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.060235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.060362] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.184387] env[69728]: INFO networking_nsxv3.common.synchronization [req-7c379e0c-2e19-40c3-b956-62dcdb7c0a69 req-878b6b35-ed9e-4cf2-ab64-99a92e3e21c3 service nova] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1316.184583] env[69728]: INFO networking_nsxv3.common.synchronization [req-7c379e0c-2e19-40c3-b956-62dcdb7c0a69 req-878b6b35-ed9e-4cf2-ab64-99a92e3e21c3 service nova] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1316.184733] env[69728]: INFO networking_nsxv3.common.synchronization [req-7c379e0c-2e19-40c3-b956-62dcdb7c0a69 req-878b6b35-ed9e-4cf2-ab64-99a92e3e21c3 service nova] Enqueued Resource ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 with Priority: HIGHEST for action port [ 1316.185363] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_rules [ 1316.185538] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1316.185663] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 with Priority: HIGHEST for action port [ 1316.185954] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.186094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.186161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.186984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.186984] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.187315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.187394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.187435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.187682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.187919] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.187919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.187919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.188177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.188177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.188367] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.188990] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a42a28f-6084-4ad3-af20-3e8c15c38458 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.189125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.189269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.189360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.189422] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a42a28f-6084-4ad3-af20-3e8c15c38458',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.562882] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb: rpc.has_security_group_logging(os_id): False [ 1316.581775] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.581924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.581996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.582222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.582316] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.582528] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.582705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.582705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.582830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.582903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.583100] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.583197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.583257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.583820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.583820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.583820] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.583820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.584148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.584148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.584148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.584298] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1316.602991] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1316.603224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.644650] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.644803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.644876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.645108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.645270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.658182] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1316.691759] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.691885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.692098] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.693085] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a42a28f-6084-4ad3-af20-3e8c15c38458 with status ACTIVE [ 1316.693576] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.694620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.694620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.694620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.694620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.694620] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.694620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.694620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.694931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.694931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.694931] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.695063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.695063] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.695644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.695644] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.695644] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a42a28f-6084-4ad3-af20-3e8c15c38458 is going to be updated. [ 1316.723149] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.723323] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.723367] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.723609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.723785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.724011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a42a28f-6084-4ad3-af20-3e8c15c38458" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.197320] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.701783] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.701783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.701783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.701783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.701783] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.701783] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 is going to be updated. [ 1317.726274] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.726357] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.726608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.726749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.726835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.737309] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: IN_PROGRESS for 2s [ 1317.774376] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 in Status: SUCCESS [ 1317.774678] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 deletion is rescheduled due to dependency. [ 1317.774678] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.675174] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1318.675174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.748628] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: SUCCESS [ 1319.748965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.749156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.749265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.749474] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.749603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.749667] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.749800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.749890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.749959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.750073] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.252903] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.755510] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a04243ff-dffd-4482-869c-4df47f3b1c84: rpc.has_security_group_logging(os_id): False [ 1320.774451] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.774753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.774753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.774991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.775122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.775416] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.775567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.775628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.775932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.775932] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.776070] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 is going to be updated. [ 1320.834492] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.834708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.834811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.835480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.835480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.850429] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: IN_PROGRESS for 2s [ 1321.186351] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.186626] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1322.550038] env[69728]: INFO networking_nsxv3.common.synchronization [req-a79babdf-9aa1-4254-94f9-ee1ba32f06af req-ea97f7cd-5228-483f-9576-0165c3cd00d7 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1322.550628] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1322.550695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.550772] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.550845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.551067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.551229] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.551329] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.551425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.551544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.551634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.551730] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.865861] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: SUCCESS [ 1322.866119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.054013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.054185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.054268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.054497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.054595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.054800] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.054899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.054961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.055153] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.055242] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.055305] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1323.089315] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.089670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.089670] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.089848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.090020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.109851] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1323.912540] env[69728]: INFO networking_nsxv3.common.synchronization [req-2641a81e-168b-4f89-a630-a3d83f4c7d3b req-c50e443e-91b0-41b7-8b01-f2fd9a8e7c3d tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1323.913196] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1323.913505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.913633] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.913699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.913914] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.915045] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.915182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.915253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.915416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.915508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.915902] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.286429] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.286761] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.286949] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.287287] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.287967] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.288170] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.288326] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.288579] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.288752] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.288976] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1324.289129] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1324.289267] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1324.289390] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1324.289509] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1324.289622] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1324.289758] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1324.309329] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1324.309489] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1324.309637] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1324.309806] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-873" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.310125] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-21ff31b2-2606-4a3f-bf52-3642f3a634c2 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.310297] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.310422] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.310728] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.310873] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ff31b2-2606-4a3f-bf52-3642f3a634c2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.418427] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.813124] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.813368] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.813530] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.813823] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.813976] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.814155] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 21ff31b2-2606-4a3f-bf52-3642f3a634c2 not found, creating... [ 1324.814426] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.814591] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.814713] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.814941] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.815098] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.815391] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.815578] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.815704] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.815926] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.816086] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.816235] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 21ff31b2-2606-4a3f-bf52-3642f3a634c2 is going to be created. [ 1324.845383] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.845690] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.845802] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.846099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.846335] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.846592] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.921310] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.122610] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1325.122610] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1325.122610] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.427337] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.427337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.427337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.427337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.427337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.427337] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1325.460027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.460027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.460027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.460027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.460027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.470053] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1326.285591] env[69728]: INFO networking_nsxv3.common.synchronization [req-2641a81e-168b-4f89-a630-a3d83f4c7d3b req-17131b02-dc51-4993-adc7-db906bfd8585 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1326.285878] env[69728]: INFO networking_nsxv3.common.synchronization [req-2641a81e-168b-4f89-a630-a3d83f4c7d3b req-17131b02-dc51-4993-adc7-db906bfd8585 service nova] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1326.285996] env[69728]: INFO networking_nsxv3.common.synchronization [req-2641a81e-168b-4f89-a630-a3d83f4c7d3b req-17131b02-dc51-4993-adc7-db906bfd8585 service nova] Enqueued Resource ID: 21ff31b2-2606-4a3f-bf52-3642f3a634c2 with Priority: HIGHEST for action port [ 1326.287044] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_rules [ 1326.287192] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1326.287293] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ff31b2-2606-4a3f-bf52-3642f3a634c2 with Priority: HIGHEST for action port [ 1326.287613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.287744] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.287811] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.288093] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.288210] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.289111] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.289227] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.289441] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ff31b2-2606-4a3f-bf52-3642f3a634c2 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.289557] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.289595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.289780] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.289870] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ff31b2-2606-4a3f-bf52-3642f3a634c2',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.791729] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.791897] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.793323] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21ff31b2-2606-4a3f-bf52-3642f3a634c2 with status ACTIVE [ 1326.793991] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.793991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.793991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.794232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.794284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.794536] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.794656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.794704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.794950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.795078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.795349] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.795488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.795616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.795729] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.795830] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.795913] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21ff31b2-2606-4a3f-bf52-3642f3a634c2 is going to be updated. [ 1326.816177] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.816341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.816389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.816714] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.816896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.817086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ff31b2-2606-4a3f-bf52-3642f3a634c2" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.482653] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1327.482653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.482653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.483165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.483244] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1327.483432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1327.483556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1327.483814] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1327.483958] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1327.484160] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1327.986997] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.489191] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.991479] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.991642] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.991688] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.991893] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.992070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.992186] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1329.030074] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.030253] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.030346] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.030609] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.030789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.039937] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1331.051553] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1331.051799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.052495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.052495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.052495] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.052495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.052891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.052891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.052891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.052891] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.053046] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.273725] env[69728]: INFO networking_nsxv3.common.synchronization [req-b32e6ba5-043b-4d67-8eff-2f3f70b60d18 req-a9d2edce-76c6-41c9-8477-341179f6e1e0 tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1331.274627] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1331.275294] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.275534] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.275719] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.276033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.276294] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.279589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.279589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.279589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.279589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.279589] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.558689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.558689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.558689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.558689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.558689] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.559443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.559443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.559443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.559443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.559443] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.580623] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-344 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.580826] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.580955] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.581237] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.581498] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.581662] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.581779] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.581997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.582272] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.582509] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1331.582627] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1331.582744] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1331.582857] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1331.582973] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1331.583102] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1331.583244] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1331.610595] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1331.610769] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1331.610913] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1331.611103] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-344" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.611424] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-a72e3dd0-c860-430a-8d9d-bf703f77e032 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.611602] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.611729] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.612101] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.612251] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a72e3dd0-c860-430a-8d9d-bf703f77e032',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.782329] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.782528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.782578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.782900] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.783041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.783399] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.783399] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.783591] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.783724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.783844] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.784047] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1331.818611] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.818761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.818833] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.819085] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.819246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.828065] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1332.061240] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef: rpc.has_security_group_logging(os_id): False [ 1332.086684] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.086852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.086933] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.087156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.087265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.087498] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.087596] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.087659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.087822] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.087903] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.088117] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.088208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.088270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.088443] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.088546] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.088793] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.089178] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.089215] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.089371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.089451] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.089540] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1332.115103] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.115362] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.115504] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.115880] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.116044] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.116207] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port a72e3dd0-c860-430a-8d9d-bf703f77e032 not found, creating... [ 1332.116484] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.116723] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.116866] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.117116] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.117262] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.117557] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.117747] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.117835] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.118093] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.118241] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.118385] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: a72e3dd0-c860-430a-8d9d-bf703f77e032 is going to be created. [ 1332.137125] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.137332] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.137452] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.137719] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.137993] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.138268] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.170863] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.170863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.170863] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.171081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.171081] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.262040] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1332.833860] env[69728]: INFO networking_nsxv3.common.synchronization [req-b32e6ba5-043b-4d67-8eff-2f3f70b60d18 req-488f2132-f218-4d17-b6a4-599fefcd1151 service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1332.833931] env[69728]: INFO networking_nsxv3.common.synchronization [req-b32e6ba5-043b-4d67-8eff-2f3f70b60d18 req-488f2132-f218-4d17-b6a4-599fefcd1151 service nova] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1332.834102] env[69728]: INFO networking_nsxv3.common.synchronization [req-b32e6ba5-043b-4d67-8eff-2f3f70b60d18 req-488f2132-f218-4d17-b6a4-599fefcd1151 service nova] Enqueued Resource ID: a72e3dd0-c860-430a-8d9d-bf703f77e032 with Priority: HIGHEST for action port [ 1332.834304] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_rules [ 1332.834437] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1332.834533] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a72e3dd0-c860-430a-8d9d-bf703f77e032 with Priority: HIGHEST for action port [ 1332.835517] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.835677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.835766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.835957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.836059] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.836898] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.837015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.837198] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-a72e3dd0-c860-430a-8d9d-bf703f77e032 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.837297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.837366] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.837527] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.837602] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a72e3dd0-c860-430a-8d9d-bf703f77e032',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.339267] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.339679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.339679] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a72e3dd0-c860-430a-8d9d-bf703f77e032 with status ACTIVE [ 1333.339800] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.339856] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.339894] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.340114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.340202] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.340372] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.340466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.340528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.340685] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.340789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.340979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.341086] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.341148] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.341289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.341364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.341448] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a72e3dd0-c860-430a-8d9d-bf703f77e032 is going to be updated. [ 1333.362982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.363165] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.363213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.363377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.363524] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.363693] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a72e3dd0-c860-430a-8d9d-bf703f77e032" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.837686] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1333.837876] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1333.837969] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.838144] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.838356] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.838540] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.838653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.838721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.838867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.838950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.839059] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.280315] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1334.280585] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.341457] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.843563] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.346800] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.347182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.347182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.347270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.347339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.347437] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1335.375674] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.375827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.375879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.376082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.376275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.384208] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1336.730519] env[69728]: INFO networking_nsxv3.common.synchronization [req-f6d02d1d-d818-42a7-9303-4fedd0e26eee req-7426b7c1-8ecf-4116-9918-db230eb99e56 tempest-ServerActionsV293TestJSON-143764121 tempest-ServerActionsV293TestJSON-143764121-project-member] Enqueued Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_members [ 1336.730733] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_members [ 1336.731232] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.731345] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.731448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.731823] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.732100] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.732280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.732406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.732703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.732857] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.733070] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.072682] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.072893] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-851" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.073031] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-851" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.073349] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-851" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.073612] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.073803] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.073927] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.074374] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.074535] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.074758] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1337.074877] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1337.074989] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1337.075114] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1337.075226] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1337.075459] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1337.075459] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1337.095117] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1337.095300] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1337.095421] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1337.095594] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-851" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.095918] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-505ef28a-1b34-4ca2-84ef-9f701e55893d taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.096106] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.096230] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.096527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.096687] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505ef28a-1b34-4ca2-84ef-9f701e55893d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.235876] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.236052] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.236159] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.236416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.236513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.236807] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.236957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.237037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.237198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.237280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.237369] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 already deleted. [ 1337.237452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.393651] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1337.393885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.394065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.394821] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.395959] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.395959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.395959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.395959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.395959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.395959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.395959] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.599527] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.599772] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.599905] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.600209] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.600397] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.600570] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 505ef28a-1b34-4ca2-84ef-9f701e55893d not found, creating... [ 1337.600845] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.601013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.601143] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.601418] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.601522] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.601849] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.602027] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.602156] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.602377] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.602516] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.602669] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 505ef28a-1b34-4ca2-84ef-9f701e55893d is going to be created. [ 1337.622730] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.622947] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.623094] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.623366] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.623602] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.623832] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.898093] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.898562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.898562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.898562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.898763] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.898869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.898952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.899157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.899246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.899342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.899505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.899652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.899706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.899846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.900048] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.900129] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.900194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.900344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.900417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.900522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.900630] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.325287] env[69728]: INFO networking_nsxv3.common.synchronization [req-f6d02d1d-d818-42a7-9303-4fedd0e26eee req-01daefce-9823-466b-860c-c96b21d7d9c4 service nova] Enqueued Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_rules [ 1338.325287] env[69728]: INFO networking_nsxv3.common.synchronization [req-f6d02d1d-d818-42a7-9303-4fedd0e26eee req-01daefce-9823-466b-860c-c96b21d7d9c4 service nova] Enqueued Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_members [ 1338.325287] env[69728]: INFO networking_nsxv3.common.synchronization [req-f6d02d1d-d818-42a7-9303-4fedd0e26eee req-01daefce-9823-466b-860c-c96b21d7d9c4 service nova] Enqueued Resource ID: 505ef28a-1b34-4ca2-84ef-9f701e55893d with Priority: HIGHEST for action port [ 1338.325287] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_rules [ 1338.325287] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_members [ 1338.325287] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 505ef28a-1b34-4ca2-84ef-9f701e55893d with Priority: HIGHEST for action port [ 1338.326085] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.326350] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.326535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.326965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.327147] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.328446] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.328720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.328896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.329205] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.330018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.330018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.330018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.330018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.330018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.330271] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.332950] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-505ef28a-1b34-4ca2-84ef-9f701e55893d taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.332950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.332950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.332950] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.332950] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('505ef28a-1b34-4ca2-84ef-9f701e55893d',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.403595] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb: rpc.has_security_group_logging(os_id): False [ 1338.419293] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.419438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.419438] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.419615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.419703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.419909] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.420017] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.420089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.420243] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.420319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.420513] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.420600] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.420662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.420803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.420879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.421067] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.421161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.421223] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.421361] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.421436] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.421518] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1338.491053] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.491247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.491247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.491460] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.491604] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.513244] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1338.835046] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.835759] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.835924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.836325] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 505ef28a-1b34-4ca2-84ef-9f701e55893d with status ACTIVE [ 1338.836325] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.836325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.836520] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.836570] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.836663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.836832] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.836916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.836981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.837152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.837230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.837420] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.837509] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.837608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.837691] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.837761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.837844] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 505ef28a-1b34-4ca2-84ef-9f701e55893d is going to be updated. [ 1338.858595] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.858766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.858884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.859169] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.859388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.859602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-505ef28a-1b34-4ca2-84ef-9f701e55893d" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.340075] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.603941] env[69728]: INFO networking_nsxv3.common.synchronization [req-d4d79a9f-a7b6-4d3f-a178-12e00ffef076 req-829d14c3-8110-4aeb-a6a0-5a84311ea816 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1339.604495] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1339.604815] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.605018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.605018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.605313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.605427] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.605515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.605621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.605754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.605849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.605981] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.841804] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.842040] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.842137] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.842343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.842473] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.842644] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 is going to be created. [ 1339.866966] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.867114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.867186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.867386] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.867540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.876793] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adf960d2-d218-41df-8d49-95f7ac039af1 in Status: UNINITIALIZED for 2s [ 1340.108921] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.531413] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1340.531904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.612339] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.115132] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.115282] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.115372] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.115578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.115673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.115864] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1341.149907] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.150056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.150132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.150352] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.150481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.159833] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1341.886478] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adf960d2-d218-41df-8d49-95f7ac039af1 in Status: SUCCESS [ 1341.886981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.886981] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.887315] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.887598] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.887763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.887868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.888114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.888244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.888383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.888523] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.392074] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.894178] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for adf960d2-d218-41df-8d49-95f7ac039af1: rpc.has_security_group_logging(os_id): False [ 1342.912414] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.912576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.912621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.913175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.913175] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.913175] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.913373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.913373] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.913448] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.914973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.914973] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 is going to be created. [ 1342.974789] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.974996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.975061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.975265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.975450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.986724] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adf960d2-d218-41df-8d49-95f7ac039af1 in Status: IN_PROGRESS for 2s [ 1343.170639] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1343.170892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.270458] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1344.270772] env[69728]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-eefccd99-162d-423b-9e2c-cceda60042c5 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1344.605580] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1344.605815] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1344.999567] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: adf960d2-d218-41df-8d49-95f7ac039af1 in Status: SUCCESS [ 1344.999567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.928842] env[69728]: INFO networking_nsxv3.common.synchronization [req-1d467956-3da3-46ee-9c15-22c4aa383bc1 req-fd625e14-20f3-4236-b225-c44077f6d573 tempest-ServersTestJSON-755823710 tempest-ServersTestJSON-755823710-project-member] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1345.929434] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGHEST for action security_group_members [ 1345.929747] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.929872] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.929942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.930152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.930308] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.930406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.930466] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.930647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.930752] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.930817] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.434070] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.434070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.434070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.434070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.434070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.434390] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.434390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.434390] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.434503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.434621] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.434666] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be updated. [ 1346.467294] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.467488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.467488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.467706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.467921] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.478497] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: IN_PROGRESS for 2s [ 1348.488751] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef in Status: SUCCESS [ 1348.489056] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef deletion is rescheduled due to dependency. [ 1348.489056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.930966] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.931378] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.931702] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.932036] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.932763] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.933226] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.372329] env[69728]: INFO networking_nsxv3.common.synchronization [req-1203bde3-de7c-48cf-8d86-4a03fdad3174 req-6bc944c7-c248-40a8-8d9e-e11f8fa72e06 tempest-ServerActionsTestJSON-975348313 tempest-ServerActionsTestJSON-975348313-project-member] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1361.372855] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGHEST for action security_group_members [ 1361.373180] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.373306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.373374] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.373568] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.373720] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.373818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.373882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.374145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.374145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.374247] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.876662] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.876867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.876945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.877172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.877265] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.877491] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.877623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.877687] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.877850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.877961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.878070] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be updated. [ 1361.916998] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.917259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.917259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.917442] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.917589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.925795] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: IN_PROGRESS for 2s [ 1363.938374] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf in Status: SUCCESS [ 1363.938754] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf deletion is rescheduled due to dependency. [ 1363.938754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.373452] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.373826] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.496171] env[69728]: INFO networking_nsxv3.common.synchronization [None req-18c11ef9-2cfd-4ab2-ac2b-e1a6d3877518 None None] Enqueued Resource ID: c7808627-5750-49c0-91b7-d7159a11da69 with Priority: HIGHEST for action port [ 1370.496171] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7808627-5750-49c0-91b7-d7159a11da69 with Priority: HIGHEST for action port [ 1370.496171] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7808627-5750-49c0-91b7-d7159a11da69 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.496171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7808627-5750-49c0-91b7-d7159a11da69" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.496171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7808627-5750-49c0-91b7-d7159a11da69" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.496171] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7808627-5750-49c0-91b7-d7159a11da69" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.496171] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7808627-5750-49c0-91b7-d7159a11da69',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.002413] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7808627-5750-49c0-91b7-d7159a11da69 [ 1371.002804] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.002962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.003050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.003298] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.003368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.003444] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7808627-5750-49c0-91b7-d7159a11da69 already deleted. [ 1371.003525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7808627-5750-49c0-91b7-d7159a11da69" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.996352] env[69728]: INFO networking_nsxv3.common.synchronization [req-c10cc41b-6333-4713-a4a3-b0c710b996cf req-de22a60c-311f-43f8-91d3-1603c144ff5f tempest-DeleteServersTestJSON-2074162099 tempest-DeleteServersTestJSON-2074162099-project-member] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1371.996862] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGHEST for action security_group_members [ 1371.997314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.997439] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.997507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.997701] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.997855] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.997954] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.998125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.998309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.998401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.998495] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.442154] env[69728]: INFO networking_nsxv3.common.synchronization [None req-866d3337-0159-4411-b465-f78fb3f6765a None None] Enqueued Resource ID: 13b9f5de-182b-4b66-8110-896e5877294c with Priority: HIGHEST for action port [ 1372.442421] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13b9f5de-182b-4b66-8110-896e5877294c with Priority: HIGHEST for action port [ 1372.442982] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-13b9f5de-182b-4b66-8110-896e5877294c taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.443127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13b9f5de-182b-4b66-8110-896e5877294c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.443197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13b9f5de-182b-4b66-8110-896e5877294c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.443449] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13b9f5de-182b-4b66-8110-896e5877294c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.443533] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13b9f5de-182b-4b66-8110-896e5877294c',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.501353] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.501515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.501559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.501785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.501870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.502088] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.502192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.502257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.502402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.502480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.502568] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be updated. [ 1372.531043] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.531207] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.531250] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.531459] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.531616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.539199] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: IN_PROGRESS for 2s [ 1372.945262] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13b9f5de-182b-4b66-8110-896e5877294c [ 1372.945652] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.945652] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.945742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.945911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.946044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.946332] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13b9f5de-182b-4b66-8110-896e5877294c already deleted. [ 1372.946332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13b9f5de-182b-4b66-8110-896e5877294c" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.550163] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb in Status: SUCCESS [ 1374.550558] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb deletion is rescheduled due to dependency. [ 1374.550558] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.036605] env[69728]: INFO networking_nsxv3.common.synchronization [req-ee5387ce-0590-4ea3-9037-3ce3cec2a042 req-4c49da76-eb10-4362-b38a-668104947784 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1376.037462] env[69728]: INFO networking_nsxv3.common.synchronization [req-9a48765e-6fe8-4810-a595-52c5017e78c0 req-6f84f327-f969-4b77-96f3-4c8f861a1864 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1376.037919] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1376.038066] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGHEST for action security_group_members [ 1376.038342] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.038463] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.038528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.038764] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.038921] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.039034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.039094] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.039247] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.039331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.039423] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.040220] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.040337] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.040404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.040556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.040695] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.040789] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.040849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.040985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.041294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.041395] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.387520] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.387748] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-58" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.387878] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-58" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.388228] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-58" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.388509] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.388666] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.388786] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.389010] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.389311] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.389595] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1376.389767] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1376.389941] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1376.390118] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1376.390317] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1376.390540] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1376.390715] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1376.415574] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1376.415816] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1376.416022] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1376.416295] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-58" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.416639] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-42a15ff0-5be4-4f3f-abac-e50f533373bf taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.416881] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.417076] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.417435] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.417643] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a15ff0-5be4-4f3f-abac-e50f533373bf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.543308] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.543500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.543555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.543754] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.543845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.544084] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.544235] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.544377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.544462] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.544540] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.544626] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 already deleted. [ 1376.544704] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.544966] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.545096] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.545163] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.545305] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.545382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.545579] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.545657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.545700] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.545818] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.545890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.545971] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 is going to be updated. [ 1376.571561] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.571736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.571736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.571919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.572053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.579502] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: IN_PROGRESS for 2s [ 1376.919896] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.921013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.921013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.921013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.921013] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.921013] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 42a15ff0-5be4-4f3f-abac-e50f533373bf not found, creating... [ 1376.921306] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.921493] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.921619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.921840] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.921985] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.922297] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.922459] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.922580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.922793] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.922931] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.923086] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf is going to be created. [ 1376.943221] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.943462] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.943978] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.945112] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.945112] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.945112] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.654320] env[69728]: INFO networking_nsxv3.common.synchronization [req-ee5387ce-0590-4ea3-9037-3ce3cec2a042 req-2d568553-ac0d-4141-85bf-855c093f0402 service nova] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_rules [ 1377.654320] env[69728]: INFO networking_nsxv3.common.synchronization [req-ee5387ce-0590-4ea3-9037-3ce3cec2a042 req-2d568553-ac0d-4141-85bf-855c093f0402 service nova] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1377.654320] env[69728]: INFO networking_nsxv3.common.synchronization [req-ee5387ce-0590-4ea3-9037-3ce3cec2a042 req-2d568553-ac0d-4141-85bf-855c093f0402 service nova] Enqueued Resource ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf with Priority: HIGHEST for action port [ 1377.654320] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_rules [ 1377.654320] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1377.654320] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf with Priority: HIGHEST for action port [ 1377.654320] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.654320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.654320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.654320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.654320] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.655605] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.655721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.655787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.655961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.656165] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.656268] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.656334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.656491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.656576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.656670] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1377.657906] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a15ff0-5be4-4f3f-abac-e50f533373bf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.658029] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.658099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.658258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.658334] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a15ff0-5be4-4f3f-abac-e50f533373bf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.161053] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a15ff0-5be4-4f3f-abac-e50f533373bf with status ACTIVE [ 1378.161053] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.161053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.161053] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.161368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.161368] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.161368] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.161496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.161496] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.161649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.161725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.161908] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.162011] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.162078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.162220] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.162295] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.162378] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf is going to be updated. [ 1378.163556] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.163671] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.163821] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.184784] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.184938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.184986] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.185145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.185277] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.185428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.589020] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a04243ff-dffd-4482-869c-4df47f3b1c84 in Status: SUCCESS [ 1378.589257] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 deletion is rescheduled due to dependency. [ 1378.589406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.666044] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.168902] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.168902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.169123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.169762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.169762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.169762] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be created. [ 1379.191922] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.191922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.191922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.192218] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.192272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.200950] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: UNINITIALIZED for 2s [ 1380.636600] env[69728]: INFO networking_nsxv3.common.synchronization [None req-aee37c6e-8b65-4482-9247-e39b18d58df6 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1380.637158] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1380.637475] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.637595] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.637673] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.637916] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.638010] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.704338] env[69728]: INFO networking_nsxv3.common.synchronization [None req-b5f6dc44-3705-465a-b556-904003be09a9 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1380.704788] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1380.705106] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.705244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.156324] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.156501] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.156549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.156733] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.156819] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.156910] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 already deleted. [ 1381.156992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.157180] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.157344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.157426] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.210715] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1381.210715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.210715] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.210910] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.211082] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.211224] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.211312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.211476] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.211559] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.211662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.211732] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1381.684075] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.684075] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.684497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.684497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.684497] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.684670] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 already deleted. [ 1381.684787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.714050] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.714302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.714302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.714450] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.714612] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.714711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.714775] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.714924] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.715021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.715107] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.715256] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.715573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.715573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.715573] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.715687] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.715738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.715805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.715937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.716021] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.716103] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.716204] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.218406] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28: rpc.has_security_group_logging(os_id): False [ 1382.237856] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.238177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.238177] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.238330] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.238388] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.238547] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.238647] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.238708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.238859] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.238930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.239142] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.239239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.239297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.239444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.239522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.239710] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.239804] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.239869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.240008] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.240091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.240195] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be created. [ 1382.293939] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1382.294167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1382.294167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1382.294319] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1382.294499] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.304885] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1384.319272] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1384.319622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.705660] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.705958] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.147917] env[69728]: INFO networking_nsxv3.common.synchronization [req-90947c92-e932-4931-84ae-3f4d2ee9c23d req-b11d4a6f-eb2d-481f-913d-d38da15b3fa9 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1386.148495] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1386.151406] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.151406] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.151406] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.151406] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.378481] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.378684] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.378815] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.379102] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.379359] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.379519] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.379638] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.379852] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.379996] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.380256] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1386.380375] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1386.380470] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1386.380579] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1386.380690] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1386.380796] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1386.380928] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1386.399792] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1386.399943] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1386.400094] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1386.400269] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.400559] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-bcd16582-59e6-46b4-83fd-46c278542475 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.400729] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.400854] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.401166] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.401343] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd16582-59e6-46b4-83fd-46c278542475',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.653061] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.653273] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.653385] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.653625] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.653703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.653884] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.653983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.654059] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.654230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.654312] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.654397] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 already deleted. [ 1386.654480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.903308] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.903813] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.903813] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.903973] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.904056] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.904188] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port bcd16582-59e6-46b4-83fd-46c278542475 not found, creating... [ 1386.904462] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.904628] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.904753] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.904977] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.905135] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.905428] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.905591] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.905712] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.905924] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.906075] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.906269] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: bcd16582-59e6-46b4-83fd-46c278542475 is going to be created. [ 1386.924550] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.924759] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.924853] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.925110] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.925349] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.925566] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.226560] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.226787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.226787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.226949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.227078] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.633039] env[69728]: INFO networking_nsxv3.common.synchronization [req-90947c92-e932-4931-84ae-3f4d2ee9c23d req-23b4bcd9-4ba2-43f7-8803-fed40c3b1034 service nova] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1387.633039] env[69728]: INFO networking_nsxv3.common.synchronization [req-90947c92-e932-4931-84ae-3f4d2ee9c23d req-23b4bcd9-4ba2-43f7-8803-fed40c3b1034 service nova] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1387.633039] env[69728]: INFO networking_nsxv3.common.synchronization [req-90947c92-e932-4931-84ae-3f4d2ee9c23d req-23b4bcd9-4ba2-43f7-8803-fed40c3b1034 service nova] Enqueued Resource ID: bcd16582-59e6-46b4-83fd-46c278542475 with Priority: HIGHEST for action port [ 1387.633039] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1387.633039] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1387.633039] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd16582-59e6-46b4-83fd-46c278542475 with Priority: HIGHEST for action port [ 1387.633039] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.633039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.633039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.633039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.633039] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.633039] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.633993] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.633993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1387.634305] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.634817] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd16582-59e6-46b4-83fd-46c278542475 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1387.634925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1387.634980] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1387.635147] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1387.635225] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd16582-59e6-46b4-83fd-46c278542475',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1387.729390] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.137380] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.137786] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.137786] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcd16582-59e6-46b4-83fd-46c278542475 with status ACTIVE [ 1388.137876] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.137993] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.138097] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.138491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.138491] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.138665] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.138736] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.138799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.138962] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.139046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.139234] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.139384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.139384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.139525] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.139664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.139777] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcd16582-59e6-46b4-83fd-46c278542475 is going to be updated. [ 1388.140877] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.169936] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.170164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.170164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.170369] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.170508] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.170694] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.231688] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.643959] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.733888] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1388.734050] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1389.146447] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.146766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.146766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.146892] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.146978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.147090] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 is going to be created. [ 1389.177453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.177628] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.177677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.177895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.178068] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.189821] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: UNINITIALIZED for 2s [ 1389.447532] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.447773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.447773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.447960] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.461099] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1389.461978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.462729] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1389.498314] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.498514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.498514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.498795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.511612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.512432] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1389.512554] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1389.512675] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1389.552484] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.552651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.552707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.552890] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.554320] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.554506] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1389.628946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.629192] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.629299] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.629589] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.629961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.630318] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1389.706085] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.706360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.706360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.706567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.706852] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.707193] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1389.707295] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c57c1ff9-39aa-42db-8159-2c763d036946', 'a462be84-fe9b-4f93-8ae7-127e786dbff3', '843812e4-7adf-4d17-bf4b-07d845b47f68', '43c7ea5a-14a1-49b6-9c97-3cef3fc76c28', '7481a9f3-6d05-4af7-91aa-204c1c681418', '70125447-a5e8-40f4-9e86-0caf7c8e5712', '98ee287a-374d-44ae-b682-134db3270cba', 'fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb', '8a4af946-c7c2-473b-b227-a6d089cb1abe', 'bac7c5b8-0d93-4c24-85a1-a5abbc41b120', 'aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc', 'a04243ff-dffd-4482-869c-4df47f3b1c84', 'dafae610-4861-4852-9c85-d723484b91f0', '15661f32-f427-4619-97c6-f59aec12ec77', 'e7f61dec-b388-42bf-a309-826f7d4ec771', 'f8408d52-084d-4902-9059-c9e45aefc511', '3fb31477-cec0-4034-8f2e-e510893e6ddf', '6ab41707-eb26-46c8-80cf-15ed1c3fe8ef', '00587369-d416-4d4c-b7d8-d80624c5056b', '562643dd-522c-4927-b2ad-26c57a85d1e3', '4f54ce0c-aa48-4762-b91f-bbd54dc523d9', '05a124ad-1f1b-4827-93f7-8088f013edda', 'c7f34be9-ffbc-4e54-a7d6-00a82c46ccc4', '33bba7e4-2298-4997-b67a-a02ac1558aa5', '7c6e384a-728d-49a1-9e35-3c446ee4ccdd', 'dd5fc210-b40b-42fd-9bcf-e190a117ea03', 'e1bbb88c-d56a-4e1c-b39c-5f69921fcc29', '159d2acb-45c2-4811-ab7d-264bdb227ed6', 'adf960d2-d218-41df-8d49-95f7ac039af1', '150816be-2a89-4f94-a1c1-0b956d39c86e', '3101a87a-3c2b-4957-a55a-4e83072e253c', '2cc1b947-36b1-4b46-9434-017900494d57', '1af596d4-70db-49cb-b5dd-9bb7c04a2bdc', '00e88d88-3454-4e14-8364-c48e1d31646f', 'd2c67d4e-4d10-4e52-a09a-e7c33344cd7a', '242249ee-0650-4468-83db-52fb528ae0d1', 'e2cb5d7a-433b-4830-98bd-52cc5ae71fef', '69ded0e1-c75f-440b-abf9-1fb132e0a59a', '4864eea1-2a57-4824-a279-fb7f17aef5fd', '444c2dd6-94e3-450f-a206-be350b315f8e', '0ed04af6-5d88-4a9b-a4a4-60feb8636b45', '9274321f-9360-470e-a510-f63db8b66689', '66798627-d216-4310-ba92-d4d31a6d6b3d', '82d01262-c022-4809-a7a7-19f567af2ac0', '954e79e4-ed41-40fb-8699-8b26721b1d77', 'a77ce3ca-085e-4feb-bd39-e12a2a43bc4f', '5b4ce391-586f-4e43-aae8-8f6f4baf13c7'} {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1389.707431] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1389.727098] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.727237] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.727322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.727495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.727582] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.727703] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1389.727766] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1389.727843] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1389.799125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.799341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.799341] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.799488] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.800627] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.800898] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1389.800973] env[69728]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69728) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1389.801061] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1389.801129] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1389.801251] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1389.801368] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGH for action security_group_rules [ 1389.801457] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGH for action security_group_rules [ 1389.801527] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGH for action security_group_rules [ 1389.801584] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGH for action security_group_rules [ 1389.801651] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGH for action security_group_rules [ 1389.801713] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGH for action security_group_rules [ 1389.801777] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGH for action security_group_rules [ 1389.801830] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGH for action security_group_rules [ 1389.801893] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGH for action security_group_rules [ 1389.801955] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGH for action security_group_rules [ 1389.802034] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGH for action security_group_rules [ 1389.802090] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGH for action security_group_rules [ 1389.802154] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGH for action security_group_rules [ 1389.802218] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGH for action security_group_rules [ 1389.802269] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGH for action security_group_rules [ 1389.802335] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGH for action security_group_rules [ 1389.802399] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGH for action security_group_rules [ 1389.802457] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGH for action security_group_rules [ 1389.802521] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGH for action security_group_rules [ 1389.802583] env[69728]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGH for action security_group_rules [ 1389.802679] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.199698] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: SUCCESS [ 1391.199996] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.200118] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.200340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.200538] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.200654] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.200720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.200870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.200973] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.201087] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.201150] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.704080] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.207429] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e8a48c9-7381-4671-9ec6-f399b1068129: rpc.has_security_group_logging(os_id): False [ 1392.226477] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.226656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.226703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.226889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.226979] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.227230] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.227331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.227400] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.227549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.227626] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.227712] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 is going to be created. [ 1392.284993] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.285145] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.285236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.285435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.285616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.300373] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: IN_PROGRESS for 2s [ 1392.631353] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.631491] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=1 [ 1392.631594] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c57c1ff9-39aa-42db-8159-2c763d036946 with Priority: HIGH for action security_group_rules [ 1392.631727] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 with Priority: HIGH for action security_group_rules [ 1392.631830] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98ee287a-374d-44ae-b682-134db3270cba with Priority: HIGH for action security_group_rules [ 1392.631930] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7f61dec-b388-42bf-a309-826f7d4ec771 with Priority: HIGH for action security_group_rules [ 1392.632044] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 with Priority: HIGH for action security_group_rules [ 1392.632143] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00587369-d416-4d4c-b7d8-d80624c5056b with Priority: HIGH for action security_group_rules [ 1392.632246] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef with Priority: HIGH for action security_group_rules [ 1392.632340] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf with Priority: HIGH for action security_group_rules [ 1392.632432] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15661f32-f427-4619-97c6-f59aec12ec77 with Priority: HIGH for action security_group_rules [ 1392.632526] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8408d52-084d-4902-9059-c9e45aefc511 with Priority: HIGH for action security_group_rules [ 1392.632616] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dafae610-4861-4852-9c85-d723484b91f0 with Priority: HIGH for action security_group_rules [ 1392.632704] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a04243ff-dffd-4482-869c-4df47f3b1c84 with Priority: HIGH for action security_group_rules [ 1392.632792] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc with Priority: HIGH for action security_group_rules [ 1392.632879] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 with Priority: HIGH for action security_group_rules [ 1392.632969] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe with Priority: HIGH for action security_group_rules [ 1392.633077] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGH for action security_group_rules [ 1392.633168] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb with Priority: HIGH for action security_group_rules [ 1392.633257] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 with Priority: HIGH for action security_group_rules [ 1392.633345] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 with Priority: HIGH for action security_group_rules [ 1392.633434] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGH for action security_group_rules [ 1392.633809] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c57c1ff9-39aa-42db-8159-2c763d036946 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.633957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.634149] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.634423] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.634510] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c57c1ff9-39aa-42db-8159-2c763d036946',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.636223] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-843812e4-7adf-4d17-bf4b-07d845b47f68 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.636425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.636516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.636923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.637030] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('843812e4-7adf-4d17-bf4b-07d845b47f68',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.639192] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98ee287a-374d-44ae-b682-134db3270cba taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.639318] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.639380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.639560] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.639642] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98ee287a-374d-44ae-b682-134db3270cba',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.640393] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7f61dec-b388-42bf-a309-826f7d4ec771 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.640505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.640563] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.640730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.640868] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7f61dec-b388-42bf-a309-826f7d4ec771',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.641490] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-562643dd-522c-4927-b2ad-26c57a85d1e3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.641618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.641680] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.641827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.641897] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('562643dd-522c-4927-b2ad-26c57a85d1e3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.644012] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00587369-d416-4d4c-b7d8-d80624c5056b taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.644213] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.644304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.644479] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.644547] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00587369-d416-4d4c-b7d8-d80624c5056b',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.646389] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.646603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.646603] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.646881] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.646969] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6ab41707-eb26-46c8-80cf-15ed1c3fe8ef',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.648396] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fb31477-cec0-4034-8f2e-e510893e6ddf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.648512] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.648581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.648741] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.648815] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fb31477-cec0-4034-8f2e-e510893e6ddf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.650760] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15661f32-f427-4619-97c6-f59aec12ec77 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.651490] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.651618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.651799] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.651877] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15661f32-f427-4619-97c6-f59aec12ec77',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.653306] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8408d52-084d-4902-9059-c9e45aefc511 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.653417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.653514] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.653636] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.654048] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8408d52-084d-4902-9059-c9e45aefc511',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.654840] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dafae610-4861-4852-9c85-d723484b91f0 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.654946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.655018] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.655186] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.655258] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dafae610-4861-4852-9c85-d723484b91f0',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.655935] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a04243ff-dffd-4482-869c-4df47f3b1c84 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.656054] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.656123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.656269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.656396] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a04243ff-dffd-4482-869c-4df47f3b1c84',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.658086] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.658195] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.658271] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.658472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.658556] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.659520] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.659608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.663056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.663056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.663056] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bac7c5b8-0d93-4c24-85a1-a5abbc41b120',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.663056] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a4af946-c7c2-473b-b227-a6d089cb1abe taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.663056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.663056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.663056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.663056] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a4af946-c7c2-473b-b227-a6d089cb1abe',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.665928] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.666065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.666132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.666338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.666432] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.667289] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.667430] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.667503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.667623] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.667702] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.668431] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7481a9f3-6d05-4af7-91aa-204c1c681418 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.671108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.671108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.671108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.671108] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7481a9f3-6d05-4af7-91aa-204c1c681418',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.671108] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a462be84-fe9b-4f93-8ae7-127e786dbff3 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.671108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.671108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.671108] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.671108] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a462be84-fe9b-4f93-8ae7-127e786dbff3',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.671521] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.671521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.671521] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.671643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.671676] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.683557] env[69728]: INFO networking_nsxv3.common.synchronization [req-970e00a4-f090-4226-acd9-b2edb1ec02e3 req-04e069ab-b52e-4992-ab75-cfa5059a8345 tempest-ServerActionsV293TestJSON-143764121 tempest-ServerActionsV293TestJSON-143764121-project-member] Enqueued Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_members [ 1392.685831] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf960d2-d218-41df-8d49-95f7ac039af1 with Priority: HIGHEST for action security_group_members [ 1392.688147] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-adf960d2-d218-41df-8d49-95f7ac039af1 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.688261] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.688324] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.688529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.688644] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.688739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.688798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.688936] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.689032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.689128] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('adf960d2-d218-41df-8d49-95f7ac039af1',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.702076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.702161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.702231] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.702447] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.704541] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.704663] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.705602] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.705699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.717977] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.718120] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a04243ff-dffd-4482-869c-4df47f3b1c84 is going to be deleted. [ 1392.718983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.719198] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.736743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.736887] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98ee287a-374d-44ae-b682-134db3270cba is going to be deleted. [ 1392.737746] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.737952] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.754867] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.755134] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc is going to be deleted. [ 1392.772461] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.772461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.772461] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.772899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.772899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.773079] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a04243ff-dffd-4482-869c-4df47f3b1c84" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.782291] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.782433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.782484] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.782662] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.782740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.782855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98ee287a-374d-44ae-b682-134db3270cba" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.799883] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.800100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.800100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.800278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.800334] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.800445] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa3dbc67-5d75-4b97-b4d2-4bf7f83192bc" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.096983] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_members [ 1393.097267] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.097687] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_members [ 1393.097822] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.098264] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-22205075-1271-4256-a141-c3f15214d130 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.098264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.098387] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.098562] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.098719] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.098820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.098884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.100843] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.100991] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.101140] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.102320] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.102428] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.102635] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.102723] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.102874] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.102975] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.103050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.103196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.103275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.103362] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.136296] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_rules [ 1393.136503] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_members [ 1393.136649] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_rules [ 1393.136784] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.136914] env[69728]: INFO networking_nsxv3.common.synchronization [req-4d9edcec-7e06-4d23-9a43-bba2bdac9928 req-dada3be1-50be-4d77-8ac8-15f15a411a28 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf with Priority: HIGHEST for action port [ 1393.137370] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_rules [ 1393.137528] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_rules [ 1393.137631] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf with Priority: HIGHEST for action port [ 1393.137746] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_members [ 1393.137868] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.138185] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22205075-1271-4256-a141-c3f15214d130 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.138502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.138502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.138931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.138931] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.139670] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.139800] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.143020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a15ff0-5be4-4f3f-abac-e50f533373bf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.143020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.143020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.143020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.143020] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a15ff0-5be4-4f3f-abac-e50f533373bf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.143020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-22205075-1271-4256-a141-c3f15214d130 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.143020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.143020] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.143020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.164067] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.164067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.164067] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.164275] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.167373] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.167528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.172367] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.172477] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.184505] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.184669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.184669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.184959] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.185043] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.185119] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.185172] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.185300] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.185404] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.185453] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.185605] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.189577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.189699] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 562643dd-522c-4927-b2ad-26c57a85d1e3 is going to be deleted. [ 1393.192051] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.192167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.192226] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.192738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.194689] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.194827] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.195351] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.195518] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.195965] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.196622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.214139] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.214139] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.226168] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.226307] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.227175] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.227297] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.228027] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.228214] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.228887] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.229026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.230157] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.230157] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.230382] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.230618] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.231164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.231260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.231873] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.231968] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.235769] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.236251] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.236380] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.237050] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1393.237544] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.237669] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fb31477-cec0-4034-8f2e-e510893e6ddf is going to be deleted. [ 1393.238516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.238724] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.257601] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.257773] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6ab41707-eb26-46c8-80cf-15ed1c3fe8ef is going to be deleted. [ 1393.258756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.258945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.275974] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.276125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15661f32-f427-4619-97c6-f59aec12ec77 is going to be deleted. [ 1393.276911] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.277132] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.297433] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.297642] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00587369-d416-4d4c-b7d8-d80624c5056b is going to be deleted. [ 1393.298505] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.298720] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.302948] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.303089] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.315281] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.315458] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.323798] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.323798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.324634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.324795] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.324902] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.324964] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.325182] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.325257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.325346] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 is going to be updated. [ 1393.326370] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.326566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.327920] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.328028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.346572] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.346572] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.348739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.348864] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a462be84-fe9b-4f93-8ae7-127e786dbff3 is going to be deleted. [ 1393.349690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.349895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.354164] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.354290] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.354351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.354535] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.354666] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.364723] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adf960d2-d218-41df-8d49-95f7ac039af1 in Status: IN_PROGRESS for 2s [ 1393.379699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.379887] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7481a9f3-6d05-4af7-91aa-204c1c681418 is going to be deleted. [ 1393.380805] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.381028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.414785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.414917] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 843812e4-7adf-4d17-bf4b-07d845b47f68 is going to be deleted. [ 1393.415796] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.416016] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.454081] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.454230] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.472183] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.472288] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb is going to be deleted. [ 1393.473414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.473414] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.475296] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.475398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.492919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.493167] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7f61dec-b388-42bf-a309-826f7d4ec771 is going to be deleted. [ 1393.493895] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.494123] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.517264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.517467] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a4af946-c7c2-473b-b227-a6d089cb1abe is going to be deleted. [ 1393.520057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.520899] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.562196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.562346] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bac7c5b8-0d93-4c24-85a1-a5abbc41b120 is going to be deleted. [ 1393.563260] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.563471] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.565807] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.565923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.580904] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.581039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.605518] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.606662] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.633606] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.634291] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dafae610-4861-4852-9c85-d723484b91f0 is going to be deleted. [ 1393.638020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.638020] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.643121] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-22205075-1271-4256-a141-c3f15214d130 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.643121] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.645945] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a15ff0-5be4-4f3f-abac-e50f533373bf with status ACTIVE [ 1393.646139] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.646389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.646389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.647810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.647810] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.647810] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.647810] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf is going to be updated. [ 1393.654454] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.654564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.685995] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.686194] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.686270] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.686553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.686721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.686925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.691778] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.700071] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.700239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.711896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.711985] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8408d52-084d-4902-9059-c9e45aefc511 is going to be deleted. [ 1393.712849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.713483] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.728535] env[69728]: INFO networking_nsxv3.common.synchronization [req-00b42e3a-088f-4b50-a3d2-51fadb05623e req-20da09e3-6aa1-4ea7-9659-125c1397c953 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_members [ 1393.728728] env[69728]: INFO networking_nsxv3.common.synchronization [req-00b42e3a-088f-4b50-a3d2-51fadb05623e req-20da09e3-6aa1-4ea7-9659-125c1397c953 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.729203] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22205075-1271-4256-a141-c3f15214d130 with Priority: HIGHEST for action security_group_members [ 1393.729340] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.729611] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-22205075-1271-4256-a141-c3f15214d130 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.729712] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.729923] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.730046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.809076] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.809304] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.813170] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.813280] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.818857] env[69728]: INFO networking_nsxv3.common.synchronization [req-00b42e3a-088f-4b50-a3d2-51fadb05623e req-20da09e3-6aa1-4ea7-9659-125c1397c953 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_rules [ 1393.819064] env[69728]: INFO networking_nsxv3.common.synchronization [req-00b42e3a-088f-4b50-a3d2-51fadb05623e req-20da09e3-6aa1-4ea7-9659-125c1397c953 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.819227] env[69728]: INFO networking_nsxv3.common.synchronization [req-00b42e3a-088f-4b50-a3d2-51fadb05623e req-20da09e3-6aa1-4ea7-9659-125c1397c953 tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf with Priority: HIGHEST for action port [ 1393.819456] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_rules [ 1393.819594] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1393.819694] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf with Priority: HIGHEST for action port [ 1393.820230] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.820331] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.820532] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.820629] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.820821] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a15ff0-5be4-4f3f-abac-e50f533373bf taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.820922] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.820985] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.821211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.821290] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a15ff0-5be4-4f3f-abac-e50f533373bf',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.825556] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.825556] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c57c1ff9-39aa-42db-8159-2c763d036946 is going to be deleted. [ 1393.825815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.825931] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.826027] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.826150] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-562643dd-522c-4927-b2ad-26c57a85d1e3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.826283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.826454] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.826530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.826655] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fb31477-cec0-4034-8f2e-e510893e6ddf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.827614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.827614] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.827707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.827798] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15661f32-f427-4619-97c6-f59aec12ec77" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.828555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.828555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.828555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.828555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6ab41707-eb26-46c8-80cf-15ed1c3fe8ef" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.828555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.828555] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.828829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.828829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00587369-d416-4d4c-b7d8-d80624c5056b" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.828904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.829033] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.829120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.829233] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a462be84-fe9b-4f93-8ae7-127e786dbff3" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.829377] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.829515] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.829598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.829703] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7481a9f3-6d05-4af7-91aa-204c1c681418" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.830082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.830244] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.830317] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.830425] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-843812e4-7adf-4d17-bf4b-07d845b47f68" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.830564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.831024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.831024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.831024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbc9d988-d2a2-4bc3-98f5-d46aa03f13cb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.831024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.831206] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.831239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.831351] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7f61dec-b388-42bf-a309-826f7d4ec771" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.831481] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.831648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.831718] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.831834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a4af946-c7c2-473b-b227-a6d089cb1abe" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.831990] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.832185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.832185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.832284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dafae610-4861-4852-9c85-d723484b91f0" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.832411] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.832578] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.832656] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.832756] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bac7c5b8-0d93-4c24-85a1-a5abbc41b120" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.990576] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.990773] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.990882] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.991158] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.991279] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.991422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8408d52-084d-4902-9059-c9e45aefc511" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.010382] env[69728]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1394.010382] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.010382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.010382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.010382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.010382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.010382] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c57c1ff9-39aa-42db-8159-2c763d036946" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.108306] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.109511] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.193889] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 70125447-a5e8-40f4-9e86-0caf7c8e5712: rpc.has_security_group_logging(os_id): False [ 1394.225147] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.225457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.225457] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.225541] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.252208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.252506] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.252634] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.252745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.252944] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.253036] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.253125] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 is going to be updated. [ 1394.312702] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: SUCCESS [ 1394.312702] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.323069] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a15ff0-5be4-4f3f-abac-e50f533373bf with status ACTIVE [ 1394.323565] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.323565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.323565] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.323738] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.324415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.324415] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.324415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.324415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.324415] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.324795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.324795] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.324795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.324795] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.324945] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.324982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.325069] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a15ff0-5be4-4f3f-abac-e50f533373bf is going to be updated. [ 1394.365338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a15ff0-5be4-4f3f-abac-e50f533373bf" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.365338] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.365338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.365338] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: IN_PROGRESS for 2s [ 1394.612344] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.612495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.612495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.612875] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.612988] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.613109] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be updated. [ 1394.614666] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.615296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.615296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.615296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.615296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.615296] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22205075-1271-4256-a141-c3f15214d130 is going to be created. [ 1394.649781] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.649949] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.650037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.650287] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.650435] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.662165] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1394.663116] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.663276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.663354] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.663598] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.663854] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.671565] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22205075-1271-4256-a141-c3f15214d130 in Status: UNINITIALIZED for 2s [ 1395.384728] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: adf960d2-d218-41df-8d49-95f7ac039af1 in Status: SUCCESS [ 1395.385581] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: adf960d2-d218-41df-8d49-95f7ac039af1 deletion is rescheduled due to dependency. [ 1395.385581] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-adf960d2-d218-41df-8d49-95f7ac039af1" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.373778] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: SUCCESS [ 1396.374032] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.672498] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1396.672802] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.673829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.674058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.674266] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.674398] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.674465] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.674624] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.674706] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.674805] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.681199] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22205075-1271-4256-a141-c3f15214d130 in Status: SUCCESS [ 1396.681199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.681199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.681452] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.681641] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.681742] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.682179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.682179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.682179] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.682179] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.176885] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.184701] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.184834] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.184907] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.185127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.185217] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.185398] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.185502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.185566] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.185711] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.185787] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.185872] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22205075-1271-4256-a141-c3f15214d130 is going to be deleted. [ 1397.216504] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.216659] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.216697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.216869] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.216953] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.217065] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.217204] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.217389] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.217544] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.217643] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.217707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.217846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.217923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.218028] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.679189] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.719951] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.720176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.720176] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.720384] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.720475] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.720670] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.720835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.720835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.720978] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.721069] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.721156] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22205075-1271-4256-a141-c3f15214d130 already deleted. [ 1397.721236] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.721333] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.722313] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.722506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.722660] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.722761] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.722828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.722971] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.723474] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.723589] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.181277] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.181690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.181690] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.181749] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.181801] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.181898] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be updated. [ 1398.211825] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.211946] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.211983] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.212193] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.212332] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.219882] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1398.225195] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22205075-1271-4256-a141-c3f15214d130',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.227610] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.227725] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.227794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.227965] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.228061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.228238] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.228339] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.228396] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.228545] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.228622] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.228747] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22205075-1271-4256-a141-c3f15214d130 already deleted. [ 1398.228828] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.727434] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22205075-1271-4256-a141-c3f15214d130: rpc.has_security_group_logging(os_id): False [ 1398.744811] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.744947] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.745015] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.745221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.745309] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.745494] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.745593] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.745657] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.745806] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.745884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.745970] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22205075-1271-4256-a141-c3f15214d130 is going to be created. [ 1398.759867] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/22205075-1271-4256-a141-c3f15214d130], does not exist path=[/infra/domains/default/groups/22205075-1271-4256-a141-c3f15214d130]."\n}' [ 1398.760010] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22205075-1271-4256-a141-c3f15214d130 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22205075-1271-4256-a141-c3f15214d130 [ 1398.760099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1398.789939] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.790064] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.790127] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.790289] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.791057] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.791298] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.791402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.791469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.791620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.791698] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.791863] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.791957] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.792030] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.792174] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.792249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.792331] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22205075-1271-4256-a141-c3f15214d130 is going to be created. [ 1398.803827] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/22205075-1271-4256-a141-c3f15214d130], does not exist path=[/infra/domains/default/groups/22205075-1271-4256-a141-c3f15214d130]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22205075-1271-4256-a141-c3f15214d130 [ 1398.803925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22205075-1271-4256-a141-c3f15214d130" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.804117] env[69728]: Traceback (most recent call last): [ 1398.804153] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1398.804153] env[69728]: return func(*args, **kwargs) [ 1398.804153] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1398.804153] env[69728]: res.raise_for_status() [ 1398.804153] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1398.804153] env[69728]: raise HTTPError(http_error_msg, response=self) [ 1398.804153] env[69728]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22205075-1271-4256-a141-c3f15214d130 [ 1398.804153] env[69728]: During handling of the above exception, another exception occurred: [ 1398.804153] env[69728]: Traceback (most recent call last): [ 1398.804380] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1398.804380] env[69728]: listener.cb(fileno) [ 1398.804380] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1398.804380] env[69728]: result = function(*args, **kwargs) [ 1398.804380] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1398.804380] env[69728]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1398.804380] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1398.804380] env[69728]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1398.804380] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1398.804380] env[69728]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1398.804380] env[69728]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1398.804380] env[69728]: res.raise_for_status() [ 1398.804380] env[69728]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1398.804380] env[69728]: raise HTTPError(http_error_msg, response=self) [ 1398.804380] env[69728]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/22205075-1271-4256-a141-c3f15214d130 [ 1398.804380] env[69728]: Removing descriptor: 61 [ 1398.820493] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.820593] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1399.062850] env[69728]: INFO networking_nsxv3.common.synchronization [req-d13ffc2d-e5eb-4d87-8513-75ec14bba9f0 req-7748c41b-46ce-4ce5-bc57-6f72d2fb63ce tempest-ServerRescueTestJSONUnderV235-731070856 tempest-ServerRescueTestJSONUnderV235-731070856-project-member] Enqueued Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1399.064024] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 with Priority: HIGHEST for action security_group_members [ 1399.064024] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.064024] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.229418] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1400.229728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.229728] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.229935] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.230140] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.230257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.230326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.230478] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.230561] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.230648] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.230745] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.231576] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.231739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.231889] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.231987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.232060] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.232201] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.232276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.232362] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.734528] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.734705] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.734956] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.735070] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.735133] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.735325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.755239] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.755442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.755549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.755615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.755788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.755870] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.755958] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be updated. [ 1400.888105] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.888259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.888259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.888432] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.888575] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.899457] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1402.912051] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1402.912051] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 deletion is rescheduled due to dependency. [ 1402.912051] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.912444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.912444] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.912499] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1402.912651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1402.912651] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1402.912858] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1402.912904] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1402.912956] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1403.415256] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.415421] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.415492] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.415716] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.415808] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.416013] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.416120] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.416185] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.416335] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.416456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.416551] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be updated. [ 1403.445649] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1403.445771] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1403.445864] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1403.446026] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1403.446167] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.454428] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1404.064898] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.065272] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 1405.464395] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1405.464721] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 deletion is rescheduled due to dependency. [ 1405.464721] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.464938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.465216] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.465456] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.465608] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.465697] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.465884] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.466034] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.466142] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1405.968803] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.968982] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.969048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.969269] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.969362] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.969572] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.969675] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.969739] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.969888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.969967] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1405.970072] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be updated. [ 1405.995937] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1405.996113] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1405.996154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1405.996322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1405.996498] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.004723] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1406.515923] env[69728]: INFO networking_nsxv3.common.synchronization [req-4b48b53e-ca7f-418f-bf37-b18bbc38058e req-67b847ec-1c4d-4769-b805-d967a61cf5e1 tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_members [ 1406.516628] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 with Priority: HIGHEST for action security_group_members [ 1406.517009] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-70125447-a5e8-40f4-9e86-0caf7c8e5712 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.517173] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.517276] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.517502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.517716] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.517868] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.517943] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.518506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.518506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.518506] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('70125447-a5e8-40f4-9e86-0caf7c8e5712',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1407.021023] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.021199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.021325] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.021506] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.041259] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.041442] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.041551] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.041611] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.041820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.041898] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.041986] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 is going to be updated. [ 1407.063422] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1407.063529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1407.063612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1407.063750] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1407.063878] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1407.071193] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: IN_PROGRESS for 2s [ 1408.014208] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1408.014513] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 deletion is rescheduled due to dependency. [ 1408.014513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.014664] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.014876] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.015078] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.015196] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.015264] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.015417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.015502] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.015588] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.015741] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.015835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.015896] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.016050] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.016188] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.016281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.016342] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.016516] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.016613] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.016649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.016747] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1408.519265] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28: rpc.has_security_group_logging(os_id): False [ 1408.536323] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.536456] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.536547] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.536759] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.536849] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.537048] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.537154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.537208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.537360] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.537437] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.537634] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.537730] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.537794] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.537938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.538019] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.538213] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.538306] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.538364] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.538507] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.538584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.538669] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be updated. [ 1408.593286] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1408.593417] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1408.593495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1408.593683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1408.593815] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1408.605880] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: IN_PROGRESS for 2s [ 1409.080414] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 in Status: SUCCESS [ 1409.080753] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 70125447-a5e8-40f4-9e86-0caf7c8e5712 deletion is rescheduled due to dependency. [ 1409.080753] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-70125447-a5e8-40f4-9e86-0caf7c8e5712" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.620814] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 in Status: SUCCESS [ 1410.621221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1410.621221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1410.621407] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1410.621497] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.139946] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.140092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.140092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.140310] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.140401] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.140499] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 is going to be deleted. [ 1411.166096] env[69728]: INFO networking_nsxv3.common.synchronization [None req-24c0532e-3319-4046-952d-2291cae6c055 tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_rules [ 1411.166263] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_rules [ 1411.166841] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.166961] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.167042] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.167292] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.167376] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.185879] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.186038] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.186083] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.186272] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.186365] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.186480] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.186885] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.187058] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.187143] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43c7ea5a-14a1-49b6-9c97-3cef3fc76c28',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.230248] env[69728]: INFO networking_nsxv3.common.synchronization [None req-41ba065a-c886-4cf9-af04-31ce9b05a3a0 tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_rules [ 1411.230569] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_rules [ 1411.231114] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.231221] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.687275] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.687653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.687653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.687653] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.687765] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.687890] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb already deleted. [ 1411.687942] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.688164] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.688255] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.688313] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1411.703591] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1411.703707] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1411.703743] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1411.703889] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1411.703970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.704072] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43c7ea5a-14a1-49b6-9c97-3cef3fc76c28 already deleted. [ 1411.704151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43c7ea5a-14a1-49b6-9c97-3cef3fc76c28" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.207629] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.207816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.207816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.207994] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.208105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.208198] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb already deleted. [ 1412.208278] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.231291] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1416.231587] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1416.408227] env[69728]: INFO networking_nsxv3.common.synchronization [req-8ff010ef-4d76-42fc-b3c7-e7baf5291978 req-4eb8e8f2-ac3b-4508-814a-a85ae0653b85 tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_members [ 1416.408358] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_members [ 1416.408655] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.408781] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.408850] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.409122] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.409282] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.409383] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.409446] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.409605] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.409677] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.409773] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.647159] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-945 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.647395] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.647540] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.647823] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.648269] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.648534] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.648698] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.648969] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.649196] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.649423] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1416.649540] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1416.649687] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1416.649816] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1416.649934] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1416.650065] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1416.650207] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1416.668789] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1416.669204] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1416.669204] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1416.669308] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-945" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.669589] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-797dda01-8700-4345-b02d-b775467ede5f taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.669738] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.669921] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.670192] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.670305] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('797dda01-8700-4345-b02d-b775467ede5f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.912107] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.912314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.912314] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.912530] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.912620] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.912822] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1416.912923] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1416.912987] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1416.913154] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1416.913232] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1416.913317] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb already deleted. [ 1416.913397] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.175099] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.175099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.175099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.175099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.175099] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.175099] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Segment Port 797dda01-8700-4345-b02d-b775467ede5f not found, creating... [ 1417.175434] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.175580] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.175657] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.175877] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.176061] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.176350] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.176560] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.176711] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.176940] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.177447] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.177447] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: 797dda01-8700-4345-b02d-b775467ede5f is going to be created. [ 1417.196959] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.197165] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.197280] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.197499] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.197746] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.198049] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.080993] env[69728]: INFO networking_nsxv3.common.synchronization [req-8ff010ef-4d76-42fc-b3c7-e7baf5291978 req-71b414ea-3abf-4a26-b524-f1640d59a159 service nova] Enqueued Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_rules [ 1418.081273] env[69728]: INFO networking_nsxv3.common.synchronization [req-8ff010ef-4d76-42fc-b3c7-e7baf5291978 req-71b414ea-3abf-4a26-b524-f1640d59a159 service nova] Enqueued Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_members [ 1418.081404] env[69728]: INFO networking_nsxv3.common.synchronization [req-8ff010ef-4d76-42fc-b3c7-e7baf5291978 req-71b414ea-3abf-4a26-b524-f1640d59a159 service nova] Enqueued Resource ID: 797dda01-8700-4345-b02d-b775467ede5f with Priority: HIGHEST for action port [ 1418.081576] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_rules [ 1418.081713] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_members [ 1418.081812] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 797dda01-8700-4345-b02d-b775467ede5f with Priority: HIGHEST for action port [ 1418.082374] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.082500] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.082564] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.082762] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.082846] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.085048] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.085048] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.085048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.085395] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.085818] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-797dda01-8700-4345-b02d-b775467ede5f taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.085928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.085992] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.086161] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.086235] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('797dda01-8700-4345-b02d-b775467ede5f',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.588146] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.588338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.589626] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.590525] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 797dda01-8700-4345-b02d-b775467ede5f with status ACTIVE [ 1418.590704] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.590820] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.590888] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.591117] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.591211] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.591381] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.591472] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.591528] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.591683] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.591763] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.591943] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.592048] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.592105] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.592246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.592322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.592406] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 797dda01-8700-4345-b02d-b775467ede5f is going to be updated. [ 1418.612224] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.612326] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.612371] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.612542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.612669] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.612816] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-797dda01-8700-4345-b02d-b775467ede5f" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.095284] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.597880] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.598041] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.598152] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.598402] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.598495] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.598627] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb is going to be created. [ 1419.621216] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.621333] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.621427] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.621553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.621699] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.629404] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb in Status: UNINITIALIZED for 2s [ 1421.639741] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb in Status: SUCCESS [ 1421.639970] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.640078] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.640283] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.640469] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.640584] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.640649] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.640803] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.640887] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.640972] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.641079] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.143439] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1422.646176] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f149e2c-3001-4d1f-b825-d8d3f770e5bb: rpc.has_security_group_logging(os_id): False [ 1422.664593] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.664769] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.664835] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.665061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.665156] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.665403] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.665503] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.665567] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.665726] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.665785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.665872] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb is going to be created. [ 1422.721221] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1422.721394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1422.721394] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1422.721553] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1422.721745] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1422.731119] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb in Status: IN_PROGRESS for 2s [ 1423.083206] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.083364] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1424.743895] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb in Status: SUCCESS [ 1424.744249] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.084190] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.084512] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.085856] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.086224] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.087753] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.087753] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.088783] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.089209] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.090049] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.090416] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.090748] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.091073] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.091505] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.091854] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.245958] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.246264] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.246355] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.246624] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.246885] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.247061] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.247215] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.249344] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.249541] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.249767] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.249885] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] NeedRegenerationException {{(pid=69728) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1460.250008] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] no value, waiting for create lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1460.250157] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] value creation lock acquired {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1460.250282] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] No value present for key: 'zone-id' {{(pid=69728) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1460.250393] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Calling creation function for not-yet-present value {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1460.250530] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1460.271151] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1460.271318] env[69728]: DEBUG dogpile.cache.region [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69728) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1460.271445] env[69728]: DEBUG dogpile.lock [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Released creation lock {{(pid=69728) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1460.271651] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "network-232" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.271937] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock port-bcd16582-59e6-46b4-83fd-46c278542475 taken with stack trace [, , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.272116] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.272238] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.272473] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.272612] env[69728]: DEBUG networking_nsxv3.api.rpc [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd16582-59e6-46b4-83fd-46c278542475',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.774879] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.775145] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.775277] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.775559] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.775715] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.776025] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.776181] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.776302] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.776527] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.776668] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.776949] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.777122] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.777265] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.777484] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.777619] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.777764] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Resource: SegmentPort with ID: bcd16582-59e6-46b4-83fd-46c278542475 is going to be updated. [ 1460.799030] env[69728]: DEBUG networking_nsxv3.common.locking [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.799217] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.799343] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.799593] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.799787] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.799997] env[69728]: DEBUG oslo_concurrency.lockutils [None req-0d1ba57d-88f6-4374-8f95-e0998ff5e7f1 None None] Releasing lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.468292] env[69728]: INFO networking_nsxv3.common.synchronization [req-8fd3f049-a705-4b08-8d7e-92d70cd0416b req-ab14b188-5b25-4b95-aff9-5ace2382fd61 service nova] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1461.468562] env[69728]: INFO networking_nsxv3.common.synchronization [req-8fd3f049-a705-4b08-8d7e-92d70cd0416b req-ab14b188-5b25-4b95-aff9-5ace2382fd61 service nova] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1461.468625] env[69728]: INFO networking_nsxv3.common.synchronization [req-8fd3f049-a705-4b08-8d7e-92d70cd0416b req-ab14b188-5b25-4b95-aff9-5ace2382fd61 service nova] Enqueued Resource ID: bcd16582-59e6-46b4-83fd-46c278542475 with Priority: HIGHEST for action port [ 1461.468841] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_rules [ 1461.468972] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1461.469089] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcd16582-59e6-46b4-83fd-46c278542475 with Priority: HIGHEST for action port [ 1461.469619] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.469740] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.469809] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.470013] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.470097] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.470903] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.471037] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.471100] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.471302] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.471453] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.471549] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.471602] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.471747] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.471855] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.471911] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.474136] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcd16582-59e6-46b4-83fd-46c278542475 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.474136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.474136] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.474322] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.474322] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcd16582-59e6-46b4-83fd-46c278542475',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.976438] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1461.977979] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.978114] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.978304] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcd16582-59e6-46b4-83fd-46c278542475 with status ACTIVE [ 1461.978470] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.978579] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.978645] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.978848] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.978937] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.979125] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.979222] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.979284] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.979469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.979513] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.979694] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.979785] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.979845] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.979984] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1461.980199] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1461.980294] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcd16582-59e6-46b4-83fd-46c278542475 is going to be updated. [ 1461.999613] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1461.999737] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1461.999777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1461.999956] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.000099] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.000246] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcd16582-59e6-46b4-83fd-46c278542475" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.482739] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1462.984668] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1462.984831] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1462.984906] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1462.985151] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1462.985258] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1462.985361] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 is going to be updated. [ 1463.015104] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1463.015340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1463.015340] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1463.015469] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1463.015616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.023611] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: IN_PROGRESS for 2s [ 1465.033607] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: SUCCESS [ 1465.033919] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.034046] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.034257] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.034493] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.034612] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.034676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.034840] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.034925] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.035028] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.035142] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.537022] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.039552] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e8a48c9-7381-4671-9ec6-f399b1068129: rpc.has_security_group_logging(os_id): False [ 1466.056845] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.057044] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.057091] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.057344] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.074615] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.074915] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.075061] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.075142] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.075431] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.075529] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.075628] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 is going to be updated. [ 1466.129215] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.129422] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.129522] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.129766] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.129941] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.140614] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: IN_PROGRESS for 2s [ 1466.470470] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.470624] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1468.155478] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: SUCCESS [ 1468.155879] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.472194] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.472194] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.473561] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.474108] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.474854] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.475134] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.476128] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.476128] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.477931] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.477931] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.364814] env[69728]: INFO networking_nsxv3.common.synchronization [req-5370887b-6810-4f57-b002-1e4d3c59989b req-cb8c1321-3a40-490a-8afb-6bdbf5b25029 tempest-AttachVolumeTestJSON-1985245755 tempest-AttachVolumeTestJSON-1985245755-project-member] Enqueued Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_members [ 1494.365020] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb with Priority: HIGHEST for action security_group_members [ 1494.365290] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.365416] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.365485] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.365682] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.365888] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.366056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.366056] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.366251] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.366338] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.366498] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f149e2c-3001-4d1f-b825-d8d3f770e5bb',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1494.869018] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.869296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.869296] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.869424] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.869519] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.869715] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.869813] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.869865] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.870082] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.870208] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.870305] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb is going to be updated. [ 1494.896386] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1494.896577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1494.896577] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1494.896708] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1494.896846] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1494.904012] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb in Status: IN_PROGRESS for 2s [ 1496.914393] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb in Status: SUCCESS [ 1496.914777] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f149e2c-3001-4d1f-b825-d8d3f770e5bb deletion is rescheduled due to dependency. [ 1496.914777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f149e2c-3001-4d1f-b825-d8d3f770e5bb" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1499.365777] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.366214] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1504.366896] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1504.367264] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1509.368587] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1509.368587] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1512.822256] env[69728]: INFO networking_nsxv3.common.synchronization [req-06df938d-8a78-4798-90ff-0e0b439780fa req-21ef894e-fea1-4408-914e-f9ea699520b5 tempest-AttachVolumeShelveTestJSON-177143037 tempest-AttachVolumeShelveTestJSON-177143037-project-member] Enqueued Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1512.822818] env[69728]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 with Priority: HIGHEST for action security_group_members [ 1512.823153] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e8a48c9-7381-4671-9ec6-f399b1068129 taken with stack trace [, , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.823281] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.823343] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.823542] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.823692] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.823788] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.823853] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.824039] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.824125] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.824220] env[69728]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e8a48c9-7381-4671-9ec6-f399b1068129',) {} {{(pid=69728) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.326741] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.326928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.326928] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.327197] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.327294] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.327512] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.327616] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.327676] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.327829] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.327930] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.328036] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 is going to be updated. [ 1513.354580] env[69728]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69728) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1513.354757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1513.354757] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1513.354938] env[69728]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1513.355092] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.362740] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: IN_PROGRESS for 2s [ 1515.373411] env[69728]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 in Status: SUCCESS [ 1515.373777] env[69728]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e8a48c9-7381-4671-9ec6-f399b1068129 deletion is rescheduled due to dependency. [ 1515.373777] env[69728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e8a48c9-7381-4671-9ec6-f399b1068129" {{(pid=69728) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.824407] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.824766] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.825427] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.825757] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.826561] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.826561] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1532.827418] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1532.827776] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1537.828956] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1537.829306] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1542.830239] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1542.830713] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1547.832904] env[69728]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1547.832904] env[69728]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0